[2024-01-03 18:05:35.713704] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF13] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.713746] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF13] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.713760] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF13] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.713794] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF13] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.713873] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF45] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:35.713932] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF13] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.713973] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF13] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:35.745084] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF45] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.745118] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF45] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.745127] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF45] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.745150] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF45] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.745204] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF32] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:35.745252] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF45] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.745265] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF45] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:35.773148] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF32] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.773181] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF32] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.773191] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF32] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.773213] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF32] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.773336] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF32] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.773349] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF32] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.126189] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:36.126228] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:36.126239] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:36.126255] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:36.309019] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:36.309054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:36.309064] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:36.364208] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:36.364279] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276336126159, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-688, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:36.364308] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:36.364669] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:36.364762] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276335427857, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1179, last_round_trip_time:797, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:36.364824] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=57] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:36.488995] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C52] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.489611] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C53] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:36.490206] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF1-00060E079C528C54] [lt=78] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.490753] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C55] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:36.491313] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF1-00060E079C528C56] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.491931] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C57] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:36.492484] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C58] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.549830] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:36.549867] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:36.549878] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:36.549894] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=96, ddl_arg=NULL) [2024-01-03 18:05:36.678047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04A] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.678588] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04B] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.678997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E04C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.679468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04D] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.714119] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF33] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.745235] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF33] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.745270] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF33] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.745283] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF33] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.745321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF33] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.745368] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF52] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.745427] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF33] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.745440] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF33] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.773063] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF52] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.773099] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF52] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.773109] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF52] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.773132] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF52] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.773232] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF52] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.773244] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF52] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.773517] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF16] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.798623] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF16] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.798656] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF16] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.798669] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF16] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.798702] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF16] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.798826] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF16] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.798846] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF16] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.151123] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B74] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.151850] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B75] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:37.152554] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B76] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.153213] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B77] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:37.153776] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B78] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.154346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B79] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:37.154979] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7A] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.311667] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:37.311696] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:37.311705] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:37.366822] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:37.366870] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276336126159, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-688, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:37.366900] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:37.368353] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:37.368444] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=38] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276335427857, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1179, last_round_trip_time:797, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:37.368480] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:37.368517] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=17] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:37.368536] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:37.368631] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=27] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:37.369450] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=37] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:37.369799] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:37.370995] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=65] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:37.371007] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:37.371355] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:37.372427] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=29] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:37.372437] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:37.372784] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=29] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:37.372816] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=28] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:37.372871] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=51] [dc=0] start to process rs list update task [2024-01-03 18:05:37.373017] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=51] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:37.373047] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=28] [dc=0] broadcast root address succeed [2024-01-03 18:05:37.374800] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:37.374878] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=53] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:37.374933] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=53] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:37.377465] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:37.378995] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=64] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:37.428972] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:37.429004] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:37.429018] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:37.429034] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:05:37.596579] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:37.596590] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:37.802764] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4A] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:37.802799] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4A] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:37.802809] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:37.802831] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:37.802892] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF36] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:37.802926] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4A] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:37.802937] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4A] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.803231] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:37.803243] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:37.803264] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:37.803298] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=10] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:37.830079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF36] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:37.830114] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF36] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:37.830124] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF36] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:37.830147] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF36] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:37.830244] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF36] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:37.830256] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF36] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.830286] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DF37] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:37.830431] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DF37] [lt=11] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:38.127298] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:38.127359] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=57] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:38.127371] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:38.127388] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:05:38.314031] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=46] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:38.314060] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:38.314069] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:38.369417] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:38.369467] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276338127254, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-584, last_round_trip_time:791, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:38.369494] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:38.370941] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:38.371002] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276337428908, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1237, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:38.371013] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:38.493448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.494094] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:05:38.494676] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.495204] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5C] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:38.495714] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.496284] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5E] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:38.496855] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.550636] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:38.550674] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:38.550686] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:38.550701] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:38.680349] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04E] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.680799] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.681222] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E050] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.681660] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E051] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.776708] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF38] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.807586] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF38] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.807624] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF38] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.807633] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF38] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.807657] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF38] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.807720] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.807758] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF38] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.807771] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF38] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:38.833354] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF1A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.833386] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF1A] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.833395] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.833417] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF1A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.833473] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF4D] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.833512] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF1A] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.833524] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:38.860039] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4D] [lt=96] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.860087] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4D] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.860100] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4D] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.860122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.860240] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4D] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.860255] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.155827] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7B] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.156515] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B7C] [lt=71] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:39.157220] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.157988] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B7E] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=38, ddl_arg=NULL) [2024-01-03 18:05:39.158539] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.159053] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B80] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:39.159586] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B81] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.316838] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:39.316871] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:39.316881] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:39.322668] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428444] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:39.372358] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:39.372413] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276338127254, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-584, last_round_trip_time:791, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:39.372438] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:39.373721] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:39.373787] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276337428908, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1237, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:39.373825] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:39.430071] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:39.430110] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:39.430122] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:39.430140] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=146, ddl_arg=NULL) [2024-01-03 18:05:39.807914] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF4E] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.835612] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.835648] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.835657] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.835680] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.835741] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.835781] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.835793] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.861963] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.862003] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF5B] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.862013] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.862035] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF5B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.862092] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.862135] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF5B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.862148] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF5B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.890750] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.890783] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3B] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.890793] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.890816] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.890911] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3B] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.890923] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3B] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.966784] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF0] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:40.128483] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.128540] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:40.128550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:40.128566] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:05:40.319235] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:40.319265] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:40.319276] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:40.376006] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:40.376055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276340128453, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-702, last_round_trip_time:805, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:40.376068] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:40.376843] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:40.376885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276339429997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1187, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:40.376896] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:40.498102] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C61] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.498885] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C62] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:40.499667] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C63] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.500249] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C64] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:40.500781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C65] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.501306] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C66] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:40.501987] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C67] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.551547] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.551586] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:40.551598] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:40.551615] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:05:40.688047] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CA] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:40.835988] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3C] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.845450] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.845520] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.845537] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.846782] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF0-00060E079A34E053] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.847597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E054] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.848078] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E055] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.848492] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E056] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.875475] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.875513] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3C] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.875524] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.875548] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.875624] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF1F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.875712] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3C] [lt=69] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.875727] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.904377] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF1F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.904422] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF1F] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.904433] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF1F] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.904457] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF1F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.904518] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF51] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.904606] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF1F] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.904626] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF1F] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.934717] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF51] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.934749] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF51] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.934758] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF51] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.934782] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF51] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.934909] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF51] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.934932] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF51] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.935009] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=9] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:40.935030] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:40.935094] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=24] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:40.935780] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:40.936128] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=35] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:40.937435] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=15] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:40.937447] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:40.937858] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=27] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:40.939362] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:40.939379] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=15] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:40.939606] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:40.939630] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:40.939639] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:05:40.939722] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:40.939744] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:05:40.941252] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=38] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:40.941322] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.941360] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=34] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:40.944395] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:40.946464] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=37] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:41.160578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B83] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.161435] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B84] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:41.162162] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B85] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.162935] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B86] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:41.163616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF2-00060E079EC94B87] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.164437] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B88] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:41.165387] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B89] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.233246] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:41.233279] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=26] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:41.418483] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:41.418492] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:41.418503] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=128) [2024-01-03 18:05:41.418509] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:41.418515] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:41.418524] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=7] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=531600136) [2024-01-03 18:05:41.418556] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=8] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:41.418579] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=21] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:41.418611] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF54] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:05:41.418716] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF54] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:41.431328] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:41.431366] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:41.431377] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:41.431394] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=95, ddl_arg=NULL) [2024-01-03 18:05:41.876003] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF60] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.904863] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF60] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.904897] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF60] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.904909] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF60] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.904944] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF60] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.905088] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.905145] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF60] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.905165] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF60] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:41.932779] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.932812] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3F] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.932821] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.932845] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.932985] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3F] [lt=47] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.932999] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:41.935127] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF22] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.965816] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF22] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.965861] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF22] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.965872] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF22] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.965896] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF22] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.966079] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF22] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.966092] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF22] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:42.129735] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:42.129784] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:42.129799] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:42.129824] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=163, ddl_arg=NULL) [2024-01-03 18:05:42.324867] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:42.324899] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:42.324909] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:42.380986] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=77] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:42.381055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276342129663, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-524, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:42.381137] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=74] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:42.381311] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:42.381354] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276341431299, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1021, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:42.381379] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:42.503735] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C68] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.504991] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C69] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=45, ddl_arg=NULL) [2024-01-03 18:05:42.505908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6A] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.506736] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C6B] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:42.507473] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6C] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.508335] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C6D] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:42.509122] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6E] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.552633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:42.552705] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=67] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:42.552718] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:42.552747] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=153, ddl_arg=NULL) [2024-01-03 18:05:42.849338] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E057] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.849935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E058] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.850609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF0-00060E079A34E059] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.851464] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05A] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.905320] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.935742] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF23] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:42.935788] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF23] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:42.935799] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF23] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:42.935822] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:42.935895] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF57] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.935932] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF23] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:42.935943] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:42.968869] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF57] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:42.968911] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF57] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:42.968927] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF57] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:42.968976] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF57] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:42.969033] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF63] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.969091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF57] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:42.969113] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF57] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.000207] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF63] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.000243] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF63] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.000253] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF63] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.000277] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF63] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.000399] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF63] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.000413] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF63] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.166736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8A] [lt=74] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.167637] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8B] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:05:43.168796] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8C] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.170019] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8D] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:43.170687] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8E] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.171380] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8F] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:43.172017] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B90] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.328083] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:43.328113] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:43.328123] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:43.384114] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:43.384165] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276342129663, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-524, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:43.384179] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:43.384386] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:43.384472] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276341431299, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1021, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:43.384508] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:43.432607] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:43.432661] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:43.432672] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:43.432693] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:05:43.936161] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF64] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:43.968142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF64] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.968181] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF64] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.968192] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF64] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.968228] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF64] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.968355] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF64] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.968369] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF64] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.969308] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF44] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:43.999707] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF44] [lt=54] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.999742] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF44] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.999752] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF44] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.999776] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF44] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.999893] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF44] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.999912] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF44] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:44.000602] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF26] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:44.028866] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF26] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:44.028888] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF26] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:44.028901] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF26] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:44.028938] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF26] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:44.029091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF26] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:44.029110] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF26] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:44.131095] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:44.131136] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:44.131153] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:44.131177] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:05:44.323466] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428445] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:44.331455] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:44.331495] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:44.331510] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:44.386540] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:44.386590] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276344131036, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-544, last_round_trip_time:844, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:44.386602] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:44.387194] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:44.387236] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276343432577, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1094, last_round_trip_time:817, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:44.387248] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:44.553780] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:44.553819] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:44.553848] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=26] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:44.553866] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:05:44.644361] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C70] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.645043] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C71] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:44.645626] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C72] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.646104] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C73] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:44.646611] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C74] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.647176] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C75] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:44.647699] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C76] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.852531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05B] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853021] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05C] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853390] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05E] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.967455] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF1] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:44.968578] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF27] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:44.998452] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF27] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:44.998491] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF27] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:44.998501] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF27] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:44.998525] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF27] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:44.998625] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF27] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:44.998637] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF27] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.000118] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF5C] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:45.030496] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF5C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:45.030532] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF5C] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:45.030541] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF5C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:45.030568] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF5C] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:45.030628] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF67] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:45.030670] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF5C] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:45.030683] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF5C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.056900] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF67] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:45.057007] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF67] [lt=103] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:45.057019] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF67] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:45.057041] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF67] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:45.057128] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF67] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:45.057141] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF67] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.057162] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:45.057180] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:45.057246] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:45.057915] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=24] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:45.058144] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:45.059069] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:45.059077] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:45.059234] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:45.060190] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:45.060197] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:45.060372] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:45.060393] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:45.060401] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:05:45.060476] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:45.060489] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:05:45.061760] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:45.061805] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=29] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:45.061815] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:45.064057] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:45.065477] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:45.284337] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:45.284349] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:45.302574] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B92] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.303301] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B93] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:45.303886] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B94] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.304500] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B95] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:45.305054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B96] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.305568] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B97] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:45.306052] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B98] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.333942] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:45.334004] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:45.334051] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:45.389094] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:45.389144] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276344131036, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-544, last_round_trip_time:844, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:45.389156] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:45.522411] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:45.522421] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:45.522432] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=129) [2024-01-03 18:05:45.522440] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:45.522448] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:45.522456] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=535704068) [2024-01-03 18:05:45.522487] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:45.522496] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:45.522525] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DF6A] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:45.522651] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DF6A] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:45.689068] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CB] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:45.847054] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.847142] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.847176] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=22] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.998814] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.026253] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.026288] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF49] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.026298] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF49] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.026321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF49] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.026419] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF49] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.026433] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.030834] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2A] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.060273] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.060321] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2A] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.060335] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2A] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.060368] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.060434] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.060485] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2A] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.060498] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.085432] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.085464] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF5F] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.085473] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.085496] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF5F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.085592] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF5F] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.085606] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF5F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.132158] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:46.132191] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:46.132201] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:46.132216] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=89, ddl_arg=NULL) [2024-01-03 18:05:46.336885] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:46.336917] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:46.336926] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:46.392343] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:46.392356] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:46.392404] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276345433640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1176, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:46.392438] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:46.392413] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276346132131, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-649, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:46.392455] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:46.554633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:46.554672] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:46.554683] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:46.554700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:05:46.648688] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C77] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.649406] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C78] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:46.650013] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C79] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.650601] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7A] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:05:46.651104] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C7B] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.651550] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:05:46.652115] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C7D] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.854697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E060] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.855572] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E061] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.856047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E062] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.856489] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E063] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.026625] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF60] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.061215] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF60] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.061251] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF60] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.061261] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF60] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.061283] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF60] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.061346] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.061452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF60] [lt=77] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.061467] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF60] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.087982] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.088012] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF6D] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.088022] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF6D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.088045] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF6D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.088143] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF6D] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.088156] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.088104] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.115750] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2D] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.115787] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2D] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.115803] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2D] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.115836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2D] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.115935] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.115964] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.306994] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B99] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.307878] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9A] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:47.308468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9B] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.309210] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9C] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:47.309781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.310368] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9E] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:47.310896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.339376] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:47.339405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:47.339414] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:47.395156] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:47.395168] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:47.395228] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276346132131, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-649, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:47.395262] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:47.395230] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276345433640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1176, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:47.395291] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=55] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:47.434565] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:47.434608] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:47.434620] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:47.434642] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:05:48.061734] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.089263] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.089297] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2E] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.089306] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.089329] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.089388] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF4E] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.089425] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.089436] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.115793] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF4E] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.115826] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF4E] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.115836] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF4E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.115859] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF4E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.116009] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF4E] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.116022] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF4E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.116127] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.133336] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:48.133375] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:48.133391] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:48.133407] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994460] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:05:48.143704] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF70] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.143745] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF70] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.143759] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF70] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.143782] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.143881] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF70] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.143895] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.342083] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:48.342116] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:48.342127] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:48.397927] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:48.397998] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276348133305, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-647, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:48.398011] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:48.398175] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:48.398218] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276347434522, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1174, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:48.398263] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:48.555652] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:48.555702] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:48.555715] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:48.555732] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:05:48.653317] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528C7E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.654270] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7F] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:05:48.655118] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C80] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.655812] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C81] [lt=110] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:48.656651] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C82] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.657264] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C83] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:05:48.658036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C84] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.857403] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E064] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858081] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E065] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858503] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E066] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858987] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E067] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.089604] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.119562] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF71] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.119596] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF71] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.119606] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF71] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.119650] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.119716] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF65] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.119760] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF71] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.119773] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.147721] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF65] [lt=30] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.147758] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF65] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.147768] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF65] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.147792] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF65] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.147849] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF31] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.147895] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF65] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.147908] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF65] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.176877] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF31] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.176907] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF31] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.176916] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF31] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.176940] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF31] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.177064] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF31] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.177076] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF31] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.177098] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:49.177117] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:49.177177] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:49.178131] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=20] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:49.178511] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:49.179721] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=37] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:49.179734] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:49.179973] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:49.180808] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:49.180815] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:49.181007] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:49.181035] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=25] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:49.181043] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:05:49.181123] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:49.181132] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:05:49.182600] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:49.182667] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=47] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:49.182679] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:49.185629] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:49.187307] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=50] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:49.312066] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA0] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.312847] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA1] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:49.313490] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA2] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.314306] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF2-00060E079EC94BA3] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:49.314971] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA4] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.315628] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:49.316351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA6] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.324269] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428446] [lt=72] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:49.344439] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:49.344499] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=50] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:49.344529] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:49.400964] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=63] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:49.400979] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:49.401016] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276348133305, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-647, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:49.401029] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:49.401045] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276347434522, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1174, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:49.401064] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:49.435670] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:49.435706] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:49.435717] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:49.435735] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:05:49.448409] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:49.448511] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=93] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:49.685761] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=13] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:49.685771] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:49.685783] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=130) [2024-01-03 18:05:49.685792] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:49.685799] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:49.685806] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=539867418) [2024-01-03 18:05:49.685834] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:49.685843] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:49.685872] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14DF34] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:49.686107] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14DF34] [lt=24] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:49.968117] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF2] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:50.119936] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF53] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.134386] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:50.134439] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:50.134456] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:50.134482] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994461] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=174, ddl_arg=NULL) [2024-01-03 18:05:50.151382] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF53] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.151426] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF53] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.151441] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF53] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.151467] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF53] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.151540] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.151623] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF53] [lt=55] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.151637] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF53] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.181352] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF74] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.181387] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF74] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.181396] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF74] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.181419] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.181478] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF68] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.181525] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF74] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.181538] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.210677] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF68] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.210716] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF68] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.210726] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF68] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.210751] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF68] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.210902] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF68] [lt=39] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.210922] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF68] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.347021] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=44] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:50.347055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:50.347065] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:50.403841] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:50.403896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276349435640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1101, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:50.403909] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:50.404105] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:50.404148] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276350134340, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:50.404189] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:50.556535] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:50.556551] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=13] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:50.556559] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=6] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:50.556574] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=69, ddl_arg=NULL) [2024-01-03 18:05:50.659091] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C86] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.659828] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C87] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:50.660591] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C88] [lt=73] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.661325] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C89] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=33, ddl_arg=NULL) [2024-01-03 18:05:50.661935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8A] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.662619] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C8B] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:50.663371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8C] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.690033] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CC] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:51.015803] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=55] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.015866] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.015882] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.016871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E069] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.017465] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06A] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.018203] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06B] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.018823] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06C] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.151789] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF69] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.182097] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF69] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.182133] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF69] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.182142] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF69] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.182165] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF69] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.182221] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF37] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.182263] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF69] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.182276] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF69] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.212043] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF37] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.212071] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF37] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.212081] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF37] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.212104] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF37] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.212225] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF37] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.212238] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF37] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.212189] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF77] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.242699] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF77] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.242731] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF77] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.242741] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF77] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.242764] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF77] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.242860] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF77] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.242872] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF77] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.317574] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA8] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.318299] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA9] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:51.319005] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAA] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.319985] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BAB] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:51.320793] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAC] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.321529] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BAD] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:51.322259] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAE] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.350118] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:51.350140] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:51.350154] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:51.407009] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=82] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:51.407087] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276349435640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1101, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:51.407129] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:51.407199] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:51.407243] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276350134340, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:51.407255] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:51.436829] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:51.436871] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:51.436890] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:51.436914] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:05:52.135604] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:52.135657] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:52.135672] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:52.135688] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994462] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:05:52.182443] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF78] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.214936] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF78] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.215002] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF78] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.215019] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF78] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.215055] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF78] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.215131] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF58] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.215197] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF78] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.215220] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF78] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.244718] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.244760] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF58] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.244775] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF58] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.244806] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.244909] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF6C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.244963] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF58] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.244976] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.273911] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF6C] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.273938] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF6C] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.273983] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF6C] [lt=43] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.274006] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF6C] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.274128] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF6C] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.274148] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF6C] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.353137] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:52.353161] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:52.353174] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:52.410122] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=45] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:52.410176] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276351436799, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1057, last_round_trip_time:854, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:52.410191] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:52.410527] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:52.410629] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276352135564, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-703, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:52.410667] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:52.557531] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:52.557589] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=55] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:52.557600] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:52.557618] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=168, ddl_arg=NULL) [2024-01-03 18:05:52.664674] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.665449] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C8E] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:05:52.666108] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8F] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.666785] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C90] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:52.667372] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C91] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.667916] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C92] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:52.668586] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C93] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.019849] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06D] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.020403] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.020998] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06F] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.021853] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E070] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.215380] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF6D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.245367] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF6D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.245404] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF6D] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.245413] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF6D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.245437] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF6D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.245534] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF6D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.245497] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF3C] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.245547] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF6D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.275743] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF3C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.275780] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF3C] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.275790] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF3C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.275813] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF3C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.275885] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.275911] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF3C] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.275929] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF3C] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.305033] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF7B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.305069] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF7B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.305078] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF7B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.305103] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.305200] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF7B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.305213] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.305234] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:53.305252] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:53.305313] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:53.306283] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:53.306479] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:53.307600] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=41] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:53.307626] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=24] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:53.307833] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=25] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:53.308902] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=19] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:53.308911] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:53.309211] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=44] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:53.309285] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=71] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:53.309295] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:53.309388] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:53.309396] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:05:53.310828] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:53.310883] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=38] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:53.310895] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:53.313417] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:53.315068] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:53.323331] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAF] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.324131] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB0] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:53.324833] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB1] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.325587] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB2] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:53.326296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB3] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.326969] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB4] [lt=60] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:05:53.327639] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB5] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.356464] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:53.356509] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:53.356524] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:53.412968] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=75] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:53.413054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276351436799, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1057, last_round_trip_time:854, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:53.413068] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:53.413552] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=61] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:53.413614] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276352135564, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-703, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:53.413646] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:53.438034] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:53.438077] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:53.438088] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:53.438108] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:53.565593] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:53.565609] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=12] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:53.787467] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:53.787481] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:53.787489] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=131) [2024-01-03 18:05:53.787495] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:53.787501] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:53.787506] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=543969119) [2024-01-03 18:05:53.787526] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:53.787535] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:53.787558] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DF7E] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:05:53.787643] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DF7E] [lt=5] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:54.136862] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:54.136932] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=67] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:54.136944] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:54.136989] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994463] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=161, ddl_arg=NULL) [2024-01-03 18:05:54.245720] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF5D] [lt=64] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.279016] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF5D] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.279047] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF5D] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.279057] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF5D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.279081] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF5D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.279151] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF70] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.279164] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF5D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.279177] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF5D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.307852] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF70] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.307894] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF70] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.307909] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF70] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.307942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF70] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.308073] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF3F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.308151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF70] [lt=63] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.308165] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF70] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.325422] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428447] [lt=60] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:54.340873] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF3F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.340926] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF3F] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.340944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF3F] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.341018] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF3F] [lt=50] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.341175] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF3F] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.341196] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF3F] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.359452] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:54.359481] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:54.359490] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:54.415837] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:54.415891] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276353437997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1049, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:54.415904] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:54.416271] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:54.416313] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276354136831, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:54.416324] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:54.558537] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:54.558558] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:54.558570] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:54.558587] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:54.823401] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C95] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.824130] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C96] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:54.825063] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C97] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.825836] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C98] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:54.826533] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C99] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.827218] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C9A] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:54.827912] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.968814] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF3] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:55.022799] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E071] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.023527] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E072] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.024130] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E073] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.024684] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E074] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.279365] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.311062] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF40] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.311106] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF40] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.311120] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF40] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.311154] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.311222] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF81] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.311312] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF40] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.311330] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.340473] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF81] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.340513] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF81] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.340527] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF81] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.340557] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF81] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.340692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF81] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.340707] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF81] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.341354] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF60] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.362938] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:55.363005] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=58] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:55.363019] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:55.369682] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF60] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.369714] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF60] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.369724] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF60] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.369747] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF60] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.369877] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF60] [lt=53] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.369898] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF60] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.418652] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:55.418700] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276353437997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1049, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:55.418731] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:55.419106] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:55.419172] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276354136831, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:55.419218] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:55.439500] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:55.439539] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:55.439550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:55.439567] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:55.482393] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB7] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.483324] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB8] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=53, ddl_arg=NULL) [2024-01-03 18:05:55.484172] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB9] [lt=80] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.484846] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBA] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:55.485471] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBB] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.486177] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBC] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:55.486893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBD] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.691162] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CD] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:56.017691] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.017740] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.017757] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.138371] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:56.138412] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:56.138423] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:56.138440] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994464] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:05:56.311488] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF75] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.339332] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF75] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.339366] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF75] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.339376] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF75] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.339399] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF75] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.339503] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF75] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.339524] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF75] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.340849] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF61] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.366003] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:56.366034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:56.366044] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:56.368357] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF61] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.368391] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF61] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.368401] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF61] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.368424] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF61] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.368522] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF61] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.368539] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF61] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.370051] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF84] [lt=81] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.399487] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF84] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.399522] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF84] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.399532] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF84] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.399556] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF84] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.399656] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF84] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.399668] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF84] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.421094] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:56.421143] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276355439470, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:56.421155] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:56.421860] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:56.421901] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276356138328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-473, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:56.421916] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:56.559468] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:56.559506] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:56.559521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:56.559544] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=111, ddl_arg=NULL) [2024-01-03 18:05:56.828806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.829491] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF1-00060E079C528C9D] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:05:56.830159] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9E] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.830788] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C9F] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:56.831360] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA0] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.831866] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA1] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:56.832376] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA2] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.025513] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E076] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E077] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026487] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E078] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026936] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2007][462][YB42C0A86EF0-00060E079A34E079] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.339720] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF62] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.368218] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF62] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.368251] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF62] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.368260] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF62] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.368284] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF62] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.368378] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF62] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.368391] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF62] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.368681] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:57.368700] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF78] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.368710] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:57.368720] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:57.401816] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF78] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.401862] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF78] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.401877] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF78] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.401909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF78] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.401996] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF47] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.402104] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF78] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.402124] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF78] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.402189] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=27] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:57.402212] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:57.402314] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=29] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:57.403048] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=38] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:57.403375] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:57.404470] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:57.404479] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:57.404774] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:57.405610] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:57.405619] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:57.405924] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:57.405996] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=68] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:57.406008] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:05:57.406125] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:57.406154] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=27] [dc=0] broadcast root address succeed [2024-01-03 18:05:57.407885] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:57.408009] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=100] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:57.408025] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:57.411184] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:57.413164] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=46] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:57.423812] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:57.423861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276355439470, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:57.423892] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:57.424287] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:57.424328] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276356138328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-473, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:57.424339] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:57.428913] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.428978] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF47] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.429002] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF47] [lt=22] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.429025] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.429129] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF47] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.429141] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.441103] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:57.441145] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:57.441161] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:57.441187] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=243, ddl_arg=NULL) [2024-01-03 18:05:57.488067] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBE] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.488786] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBF] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:57.489465] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC0] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.490243] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC1] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:57.490908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF2-00060E079EC94BC2] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.491538] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC3] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:57.492160] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC4] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.769342] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:57.769353] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:57.983409] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:57.983419] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:57.983431] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=132) [2024-01-03 18:05:57.983440] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:57.983447] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:57.983454] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=548165066) [2024-01-03 18:05:57.983478] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:57.983492] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:57.983518] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF7B] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:57.983639] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF7B] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:58.139696] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=51] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:58.139743] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:58.139759] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:58.139778] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994465] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:58.368594] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF65] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.371077] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:58.371089] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:58.371098] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:58.396244] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF65] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.396277] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF65] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.396287] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF65] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.396311] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF65] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.396448] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF65] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.396468] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF65] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.402314] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF48] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.426671] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:58.426719] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276357441072, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-886, last_round_trip_time:911, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:58.426734] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:58.427012] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:58.427052] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276358139667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:922, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:58.427086] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:58.430291] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF48] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.430317] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF48] [lt=24] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.430326] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF48] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.430348] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF48] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.430426] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF66] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.430612] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF48] [lt=161] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.430642] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF48] [lt=20] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.461645] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF66] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.461681] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF66] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.461691] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF66] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.461716] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF66] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.461811] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF66] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.461823] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF66] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.560337] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:58.560373] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:58.560384] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:58.560400] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:05:58.833285] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA3] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.834180] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA4] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:58.834821] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA5] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.835315] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF1-00060E079C528CA6] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:58.835887] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.836473] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA8] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:58.837010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA9] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.027711] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07A] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.028247] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07B] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.028611] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07C] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.029039] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.326402] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428448] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:59.373862] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=64] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:59.373896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:59.373912] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:59.396650] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF8D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.427079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF8D] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.427097] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF8D] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.427106] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF8D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.427129] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.427219] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF8D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.427231] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF8D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.429500] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:59.429592] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=43] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:59.429550] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276358139667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:922, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:59.429619] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=63] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:59.429660] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276357441072, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-886, last_round_trip_time:911, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:59.429690] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:59.430836] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF80] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.442223] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:59.442286] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=56] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:59.442306] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=16] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:59.442333] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:05:59.467000] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF80] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.467046] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF80] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.467060] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF80] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.467093] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF80] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.467165] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF8E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.467234] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF80] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.467254] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF80] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.493269] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC5] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.494251] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC6] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:59.494857] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC7] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.495474] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC8] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:59.496133] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94BC9] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.496649] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BCA] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:59.497213] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCB] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.497292] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF8E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.497313] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF8E] [lt=19] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.497323] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF8E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.497346] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF8E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.497502] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF8E] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.497517] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF8E] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.969478] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF4] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:00.140771] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:00.140817] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:00.140834] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:00.140856] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994466] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=117, ddl_arg=NULL) [2024-01-03 18:06:00.376812] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:00.376842] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:00.376851] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:00.427384] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF4B] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.431979] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:00.432029] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276360140739, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-629, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:00.432042] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:00.432068] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:00.432109] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276359442179, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1066, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:00.432144] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:00.459853] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF4B] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.459875] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF4B] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.459884] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF4B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.459908] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF4B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.460051] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF4B] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.460069] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF4B] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.467440] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF6B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.499331] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF6B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.499373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF6B] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.499385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF6B] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.499418] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF6B] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.499547] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF6B] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.499498] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.499564] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF6B] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.530180] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF83] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.530219] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF83] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.530229] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.530253] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF83] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.530343] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF83] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.530357] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.561136] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:00.561175] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:00.561186] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:00.561206] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:00.692140] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CE] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:00.838003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAB] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.838824] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CAC] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:06:00.839495] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAD] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.840536] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CAE] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=37, ddl_arg=NULL) [2024-01-03 18:06:00.841332] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAF] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.841968] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB0] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:00.842641] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB1] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.196886] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=29] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.196917] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=13] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.196933] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.198003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07F] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.198671] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E080] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.199297] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E081] [lt=90] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.199986] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E082] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.379810] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:01.379875] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:01.379889] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:01.434491] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:01.434541] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276360140739, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-629, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:01.434553] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:01.434645] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:01.434687] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276359442179, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1066, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:01.434713] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:01.434734] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:01.434747] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:01.434807] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=19] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:01.435598] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=19] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:01.435791] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:01.436868] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:01.436880] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:01.437224] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:01.438569] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:01.438575] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:01.438747] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:01.438756] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:01.438763] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:06:01.438842] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:01.438854] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:06:01.440148] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:01.440179] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=15] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:01.440203] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:01.443217] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:01.443396] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:01.443422] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=22] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:01.443437] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:01.443460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:01.444984] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=73] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:01.460233] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF84] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.490669] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF84] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.490691] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF84] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.490703] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF84] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.490727] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF84] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.490864] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF84] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.490884] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF84] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.498394] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCD] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.499435] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BCE] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:01.499725] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF93] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.500189] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCF] [lt=82] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.500860] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD0] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:01.501498] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD1] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.502457] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD2] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:01.503280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD3] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.530464] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF93] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.530497] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF93] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.530508] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF93] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.530530] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF93] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.530600] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF4E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.530651] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF93] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.530664] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF93] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.562249] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF4E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.562278] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF4E] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.562291] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF4E] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.562326] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF4E] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.562454] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF4E] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.562471] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF4E] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.685146] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:01.685162] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=12] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:01.889779] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:01.889787] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:01.889797] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=133) [2024-01-03 18:06:01.889804] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:01.889811] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:01.889817] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=552071430) [2024-01-03 18:06:01.889839] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:01.889846] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:01.889870] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DF70] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:01.890017] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DF70] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:02.141872] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:02.141909] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:02.141920] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:02.141937] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994467] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:02.382533] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:02.382546] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:02.382555] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:02.437308] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=67] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:02.437375] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276361443359, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:933, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:02.437395] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:02.437440] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:02.437482] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276362141842, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-678, last_round_trip_time:918, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:02.437514] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:02.491095] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF71] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.521060] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF71] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.521110] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF71] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.521125] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF71] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.521160] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF71] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.521310] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF71] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.521326] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF71] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.530834] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF87] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.562224] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:02.562258] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:02.562270] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:02.562297] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:06:02.564578] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF87] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.564612] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF87] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.564625] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF87] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.564658] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF87] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.564727] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF51] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.564789] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF87] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.564814] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF87] [lt=16] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.593419] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF51] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.593454] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF51] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.593464] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF51] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.593486] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF51] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.593608] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF51] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.593621] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF51] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.843597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB2] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.844500] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB3] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:02.845453] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB4] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.846324] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB5] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:02.847188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB6] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.847863] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB7] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:02.848440] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB8] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.201010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E083] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.201531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E084] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.202212] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E085] [lt=78] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.202708] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E086] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.385310] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:03.385341] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:03.385350] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:03.439985] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:03.440034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276361443359, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:933, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:03.440056] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:03.440435] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:03.440478] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276362141842, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-678, last_round_trip_time:918, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:03.440505] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:03.444525] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:03.444599] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:03.444611] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:03.444627] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:06:03.504776] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94BD4] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.505771] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD5] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:03.506421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.507560] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD7] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:03.508428] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD8] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.509150] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD9] [lt=67] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:03.509867] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BDA] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.521469] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF52] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.548875] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF52] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.548911] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF52] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.548921] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF52] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.548944] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF52] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.549119] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF52] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.549141] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF52] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:03.565052] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.594471] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF98] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.594507] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF98] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.594516] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF98] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.594539] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.594613] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.594687] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF98] [lt=60] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.594700] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:03.624416] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.624450] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF74] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.624460] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.624483] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF74] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.624581] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF74] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.624593] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF74] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.143044] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:04.143103] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=55] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:04.143162] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=55] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:04.143179] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994468] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=189, ddl_arg=NULL) [2024-01-03 18:06:04.327308] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428449] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:04.388041] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:04.388071] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:04.388081] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:04.442348] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:04.442400] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276363444496, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-968, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:04.442440] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:04.442853] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:04.442895] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276364142994, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-598, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:04.442919] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:04.549292] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF75] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.563658] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=39] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:04.563698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:04.563709] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:04.563727] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:04.578857] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF75] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.578895] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF75] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.578905] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF75] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.578929] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF75] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.579054] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF75] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.579067] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF75] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.594920] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.622522] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.622539] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF8C] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.622548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.622571] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF8C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.622679] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF8C] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.622694] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF8C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.624742] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF55] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.652093] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF55] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.652131] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF55] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.652141] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF55] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.652163] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF55] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.652263] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF55] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.652276] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF55] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.970128] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF5] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:04.984356] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBA] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.985132] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBB] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:04.985709] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBC] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.986346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBD] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:04.986909] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.987367] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBF] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:04.987857] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.203661] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E087] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204129] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E088] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204486] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E089] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08A] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.391110] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:05.391149] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:05.391164] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:05.445031] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=115] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:05.445115] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276363444496, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-968, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:05.445145] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:05.445392] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:05.445459] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276364142994, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-598, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:05.445486] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:05.445507] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:05.445547] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=32] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:05.445628] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=42] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:05.445755] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:05.445793] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:05.445809] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:05.445827] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:05.446308] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=23] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:05.446494] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:05.447413] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:05.447421] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:05.447605] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:05.448394] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:05.448404] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:05.448587] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:05.448608] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=18] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:05.448616] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:05.448775] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:05.448784] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=8] [dc=0] broadcast root address succeed [2024-01-03 18:06:05.450046] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:05.450098] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:05.450116] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=15] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:05.452353] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:05.453805] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:05.579208] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF56] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:05.644204] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BDF] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:05.644678] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.645207] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE1] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:05.645684] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE2] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.651479] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF9D] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:05.651516] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF9D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:05.651527] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF9D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:05.651551] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF9D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:05.651717] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF9D] [lt=84] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:05.651733] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF9D] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:05.652418] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:05.661115] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:05.661125] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:05.679638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF78] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:05.679656] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF78] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:05.679665] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF78] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:05.679688] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:05.679795] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF78] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:05.679807] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:05.846260] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:05.846268] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:05.846280] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=134) [2024-01-03 18:06:05.846291] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:05.846299] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:05.846306] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=556027918) [2024-01-03 18:06:05.846332] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:05.846339] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:05.846364] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF91] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:05.846487] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF91] [lt=18] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:06.144289] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:06.144310] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:06.144321] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:06.144337] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994469] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=83, ddl_arg=NULL) [2024-01-03 18:06:06.198267] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.198334] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=45] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.198352] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.393761] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:06.393788] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:06.393840] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=49] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:06.447504] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:06.447567] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276365445724, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-960, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:06.447580] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:06.447760] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:06.447802] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276366144256, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:06.447827] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:06.564557] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:06.564597] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:06.564609] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:06.564626] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:06.609269] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF92] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.638862] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF92] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.638898] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF92] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.638908] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF92] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.638931] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF92] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.639070] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF92] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.639087] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF92] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.651940] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.678691] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.678735] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF59] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.678744] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.678768] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF59] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.678869] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF59] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.678882] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF59] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.679988] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA0] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.707801] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.707838] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA0] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.707853] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA0] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.707877] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.708000] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA0] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.708015] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.988869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC1] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.989717] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC2] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:06.990351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC3] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.990917] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC4] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:06.991460] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.991934] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC6] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:06.992378] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC7] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.205718] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08C] [lt=62] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.206265] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08D] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.206650] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08E] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.207024] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08F] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.396376] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:07.396405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:07.396432] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:07.446880] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:07.446911] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:07.446922] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:07.446980] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:06:07.449888] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:07.449939] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276367446849, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1005, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:07.449974] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:07.450026] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:07.450068] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276366144256, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:07.450100] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:07.639248] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.646690] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE3] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.647529] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE4] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:07.648363] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.648965] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE6] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:07.649486] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE7] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.649989] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE8] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:07.650445] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE9] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.670055] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.670074] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA1] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.670083] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.670106] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.670206] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA1] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.670220] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:07.679045] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF7D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.707000] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF7D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.707035] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF7D] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.707045] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF7D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.707068] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF7D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.707170] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF7D] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.707183] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF7D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:07.708161] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.734638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.734675] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF95] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.734685] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.734708] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF95] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.734810] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF95] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.734824] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF95] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.145402] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:08.145441] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:08.145453] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:08.145470] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:08.398833] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:08.398864] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:08.398874] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:08.452980] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=56] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:08.453012] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:08.453031] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276367446849, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1005, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:08.453044] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:08.453054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276368145370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-695, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:08.453066] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:08.565400] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:08.565435] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:08.565445] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:08.565460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:08.670393] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF96] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.702504] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF96] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.702540] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF96] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.702550] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF96] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.702583] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF96] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.702707] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF96] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.702721] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF96] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.707321] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF5E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.737538] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF5E] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.737565] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF5E] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.737581] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF5E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.737605] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF5E] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.737721] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA4] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.737803] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF5E] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.737817] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF5E] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.768663] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA4] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.768697] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA4] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.768707] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.768730] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.768827] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA4] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.768839] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA4] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.993416] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.994192] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC9] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:08.994774] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCA] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.995364] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CCB] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:08.996046] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCC] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.996743] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CCD] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:08.997418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCE] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.208013] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E090] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.208580] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E091] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.209054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E092] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.209674] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E093] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.328157] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:09.401340] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:09.401371] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:09.401385] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:09.447940] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:09.447987] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:09.447998] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:09.448015] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:06:09.455419] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:09.455471] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276368145370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-695, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:09.455484] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:09.455629] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:09.455705] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276369447911, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-978, last_round_trip_time:956, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:09.455725] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:09.455743] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:09.455757] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:09.455802] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=11] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:09.456836] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=54] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:09.457274] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=63] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:09.458406] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:09.458436] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=27] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:09.458773] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:09.459804] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=30] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:09.459815] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:09.460170] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:09.460208] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:09.460220] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:09.460327] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:09.460362] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=32] [dc=0] broadcast root address succeed [2024-01-03 18:06:09.462281] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:09.462353] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=50] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:09.462368] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:09.465630] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=21] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:09.469390] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=56] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:09.651423] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEA] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.652172] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BEB] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:09.653158] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEC] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.654026] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BED] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:09.654813] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEE] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.655597] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BEF] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:09.656289] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF0] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.702877] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.735849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.735885] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA5] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.735899] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA5] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.735937] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA5] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.736119] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA5] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.736135] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA5] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.737935] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.741030] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:09.741041] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:09.771849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.771896] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF82] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.771911] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF82] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.771938] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF82] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.772064] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF82] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.772077] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.772050] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF61] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.803413] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF61] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.803454] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF61] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.803464] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF61] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.803487] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF61] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.803575] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF61] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.803587] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF61] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.944841] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=21] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:09.944850] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:09.944860] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=135) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:06:09.944878] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=17] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:09.944885] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:09.944891] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=560126504) [2024-01-03 18:06:09.944909] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:09.944921] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=11] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:09.944961] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF9B] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:09.945070] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF9B] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:09.970765] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF6] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:10.146633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=21] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:10.146672] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:10.146683] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:10.146700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:06:10.404102] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:10.404136] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:10.404154] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:10.457815] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:10.457866] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276370146575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-607, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:10.457879] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:10.458263] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:10.458305] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276369447911, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-978, last_round_trip_time:956, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:10.458324] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:10.566240] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:10.566280] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:10.566291] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:10.566308] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:10.694106] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D0] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:10.736291] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF9C] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.767768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF9C] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.767801] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF9C] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.767811] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF9C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.767836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF9C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.767934] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF9C] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.767965] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF9C] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.772217] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA8] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.802519] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.802569] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA8] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.802584] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.802608] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.802715] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA8] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.802732] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.803746] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF85] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.834439] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF85] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.834484] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF85] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.834496] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF85] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.834533] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF85] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.834682] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF85] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.834700] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF85] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.998502] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD0] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:10.999166] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD1] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:10.999801] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD2] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.000372] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD3] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:11.001103] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD4] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.001652] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD5] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:11.002171] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD6] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.344063] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344121] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=36] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344138] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344964] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E095] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.345388] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E096] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.345775] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E097] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.346169] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E098] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.406454] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:11.406487] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:11.406497] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:11.449250] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:11.449290] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:11.449301] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:11.449326] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:06:11.460398] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=78] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:11.460454] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276370146575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-607, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:11.460473] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:11.460767] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:11.460853] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276371449219, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-817, last_round_trip_time:955, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:11.460880] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:11.657459] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF2] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.658124] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF3] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:11.658829] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF4] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.659455] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:11.660068] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.660602] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF7] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:11.661128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.768103] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF86] [lt=17] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.796673] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF86] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.796716] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF86] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.796733] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF86] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.796768] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF86] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.796890] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF86] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.796903] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF86] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:11.802883] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF66] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.830509] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF66] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.830544] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF66] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.830554] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF66] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.830578] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF66] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.830735] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF66] [lt=82] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.830749] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF66] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:11.834867] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.862159] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF9F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.862192] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF9F] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.862201] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF9F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.862225] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.862324] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF9F] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.862337] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.147988] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:12.148076] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=82] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:12.148093] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:12.148114] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=194, ddl_arg=NULL) [2024-01-03 18:06:12.408814] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:12.408844] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:12.408853] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:12.463467] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:12.463517] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276372147922, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-652, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:12.463589] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=67] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:12.464169] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:12.464230] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276371449219, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-817, last_round_trip_time:955, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:12.464265] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:12.567194] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:12.567246] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:12.567257] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:12.567277] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=114, ddl_arg=NULL) [2024-01-03 18:06:12.797095] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.826218] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.826263] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA0] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.826278] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA0] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.826303] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA0] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.826430] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA0] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.826443] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.830961] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.860599] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFAD] [lt=47] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.860636] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFAD] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.860646] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFAD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.860670] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.860757] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFAD] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.860769] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.862492] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF89] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.888328] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF89] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.888362] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF89] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.888371] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF89] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.888395] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF89] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.888522] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF89] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.888535] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF89] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.003088] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD7] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.003839] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD8] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:13.004579] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD9] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.005102] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CDA] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.005578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.006253] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CDC] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:13.006709] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDD] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.347035] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E099] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.347647] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.348074] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09B] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.348396] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09C] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.411278] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:13.411308] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:13.411317] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:13.450406] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=35] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:13.450469] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=59] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:13.450480] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:13.450522] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=148, ddl_arg=NULL) [2024-01-03 18:06:13.465985] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:13.466057] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276372147922, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-652, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:13.466085] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:13.466817] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:13.466860] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276373450376, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-934, last_round_trip_time:960, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:13.466872] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:13.466892] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:13.466905] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:13.466966] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:13.467673] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=30] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:13.467869] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:13.469035] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=33] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:13.469042] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:13.469315] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=23] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:13.470910] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:13.470917] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:13.471107] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:13.471124] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=15] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:13.471132] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:13.471215] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=25] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:13.471223] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:06:13.472395] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:13.472454] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:13.472469] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:13.474767] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:13.476424] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=36] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:13.662147] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF9] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.662940] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFA] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:13.663721] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFB] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.664372] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFC] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.664895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFD] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.665524] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFE] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.666128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFF] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.698507] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:13.698522] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=11] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:13.826595] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF8A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:13.889749] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:13.889786] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:13.889796] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:13.889819] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:13.889894] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:13.889920] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6B] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:13.889932] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.901264] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:13.901275] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:13.901287] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=136) [2024-01-03 18:06:13.901295] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:13.901303] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:13.901311] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=564082923) [2024-01-03 18:06:13.901343] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:13.901351] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:13.917285] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:13.917320] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA3] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:13.917330] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:13.917353] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:13.917452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA3] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:13.917465] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.917495] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DFA4] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:13.917651] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DFA4] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:14.149138] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:14.149177] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:14.149188] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:14.149203] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:14.329009] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844B] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:14.413639] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:14.413667] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:14.413676] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:14.468877] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:14.468940] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276374149108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-704, last_round_trip_time:920, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:14.468993] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=48] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:14.469138] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:14.469180] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276373450376, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-934, last_round_trip_time:960, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:14.469212] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:14.568164] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:14.568203] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:14.568214] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:14.568230] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:14.856434] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA5] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.883341] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.883375] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA5] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.883385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.883409] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.883508] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA5] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.883520] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.890129] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF8D] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.917512] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF8D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.917539] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF8D] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.917548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF8D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.917571] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.917622] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF6E] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.917714] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF8D] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.917734] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF8D] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.947084] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6E] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.947121] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6E] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.947131] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.947154] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.947254] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6E] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.947267] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.971378] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF7] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:15.134990] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDF] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.135711] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE0] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:15.136414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE1] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.137006] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE2] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:15.137555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE3] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.138165] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE4] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:15.138736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE5] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.349163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09D] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.349894] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.350463] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09F] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.350982] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A0] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.416320] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:15.416335] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:15.416345] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:15.451366] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:15.451417] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:15.451435] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:15.451460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:06:15.471561] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:15.471611] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276374149108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-704, last_round_trip_time:920, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:15.471637] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:15.472049] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:15.472091] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276375451322, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1020, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:15.472103] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:15.694973] INFO [RS] ob_rs_rpc_processor.h:196 [2021][490][YB42C0A86EF2-00060E079EA943D1] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:15.796149] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94C01] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.796882] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C02] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:15.797525] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C03] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.798052] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C04] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:15.798524] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C05] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.799076] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C06] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:15.799638] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C07] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.883686] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.914009] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.914047] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6F] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.914058] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.914081] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.914184] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6F] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.914197] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:15.917914] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFB6] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.946070] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFB6] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.946113] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFB6] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.946124] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFB6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.946147] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFB6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.946247] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFB6] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.946260] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFB6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:15.947453] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.975449] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.975485] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.975499] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.975528] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.975676] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA8] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.975697] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:16.150156] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=32] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:16.150193] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:16.150205] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:16.150220] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:16.345617] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.345680] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.345697] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.418820] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:16.418849] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:16.418858] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:16.474424] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:16.474480] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276376150125, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-623, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:16.474526] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:16.474862] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:16.474907] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276375451322, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1020, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:16.474918] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:16.568978] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:16.569026] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:16.569044] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:16.569067] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=138, ddl_arg=NULL) [2024-01-03 18:06:16.914339] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.947185] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA9] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:16.947257] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA9] [lt=67] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:16.947273] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA9] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:16.947300] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA9] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:16.947369] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF92] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.947399] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA9] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:16.947413] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:16.977278] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF92] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:16.977327] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF92] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:16.977341] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF92] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:16.977372] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF92] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:16.977443] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF72] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.977597] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF92] [lt=94] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:16.977615] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF92] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.006882] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF72] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:17.006916] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF72] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:17.006925] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF72] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:17.006966] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF72] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:17.007066] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF72] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:17.007079] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF72] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.007100] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:17.007118] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:17.007191] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:17.008191] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=63] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:17.008373] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:17.009710] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:17.009718] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:17.009929] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=42] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:17.010863] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:17.010869] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:17.011061] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:17.011084] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:17.011092] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:17.011172] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:17.011187] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:06:17.012610] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:17.012669] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:17.012680] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:17.015094] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:17.016561] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:17.139870] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE6] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.140613] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE7] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:17.141436] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE8] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.142193] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE9] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:17.142878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEA] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.143906] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CEB] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:17.144905] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEC] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.273182] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:17.273193] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:17.352032] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A2] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.352766] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A3] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.353468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A4] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.353932] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A5] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.452518] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DF] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:17.522725] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=19] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:17.522736] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:17.522748] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=137) [2024-01-03 18:06:17.522756] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:17.522764] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:17.522772] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=567704384) [2024-01-03 18:06:17.522804] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:17.522839] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=32] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:17.522870] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14DF75] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:06:17.523034] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14DF75] [lt=28] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:17.800843] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C08] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.801940] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C09] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:06:17.802942] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.804006] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C0B] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:17.805507] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0C] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.806867] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C0D] [lt=54] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:17.808004] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0E] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.947558] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBB] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:17.983796] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBB] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:17.983856] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBB] [lt=56] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:17.983870] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBB] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:17.983909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBB] [lt=15] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:17.984093] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBB] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:17.984109] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBB] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.984134] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFAC] [lt=34] [dc=1] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:18.015920] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFAC] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:18.015982] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFAC] [lt=58] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:18.016012] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFAC] [lt=27] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:18.016046] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFAC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:18.016129] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF95] [lt=35] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:18.016200] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFAC] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:18.016218] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFAC] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:18.045742] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF95] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:18.045775] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF95] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:18.045786] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF95] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:18.045809] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF95] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:18.045908] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF95] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:18.045920] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF95] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:18.151230] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=41] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:18.151272] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:18.151283] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:18.151301] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:18.424175] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:18.424206] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:18.424214] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:18.479475] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:18.479522] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276378151199, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-611, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:18.479533] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:18.479857] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:18.479896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276377452488, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-905, last_round_trip_time:888, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:18.479920] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:18.569844] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:18.569880] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:18.569894] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:18.569910] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:06:18.984258] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF96] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.018372] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF96] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.018389] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF96] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.018398] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF96] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.018421] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF96] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.018515] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF78] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.018544] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF96] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.018562] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF96] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.048584] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF78] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.048659] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF78] [lt=71] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.048676] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF78] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.048709] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF78] [lt=14] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.048796] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.048870] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF78] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.048891] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF78] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.077796] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.077823] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBE] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.077832] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.077855] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.077975] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBE] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.077991] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBE] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.146164] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CED] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.147067] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CEE] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:19.148530] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEF] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.149552] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF0] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:19.150448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF1] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.151178] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF2] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:19.151911] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF3] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.329940] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844C] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:19.354771] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF0-00060E079A34E0A6] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.355499] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A7] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.356351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A8] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.362644] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF0-00060E079A34E0A9] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.426714] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=54] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:19.426727] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:19.426737] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:19.453644] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:19.453698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:19.453714] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:19.453731] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:06:19.482252] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=96] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:19.482304] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276378151199, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-611, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:19.482317] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:19.482920] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:19.482992] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276379453604, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:19.483023] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:19.809401] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0F] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.810332] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C10] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=41, ddl_arg=NULL) [2024-01-03 18:06:19.811578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C11] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.812420] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C12] [lt=105] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:06:19.813053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C13] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.813651] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C14] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:19.814271] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C15] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.972120] INFO [RS] ob_rs_rpc_processor.h:196 [2021][490][YB42C0A86EF0-00060E079A24DAF8] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:20.018743] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.049671] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.049705] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBF] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.049715] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.049738] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.049812] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB1] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.049860] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBF] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.049872] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBF] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.077666] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.077700] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB1] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.077710] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.077739] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB1] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.077844] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB1] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.077857] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.078160] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF99] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.108848] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF99] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.108892] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF99] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.108905] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF99] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.108929] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF99] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.109062] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF99] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.109075] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF99] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.152457] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:20.152533] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:20.152550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:20.152573] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994470] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=181, ddl_arg=NULL) [2024-01-03 18:06:20.429244] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:20.429274] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:20.429283] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:20.485137] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:20.485217] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276380152394, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-564, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:20.485273] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=52] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:20.486421] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:20.486470] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276379453604, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:20.486520] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=46] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:20.570753] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:20.570793] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:20.570804] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:20.570820] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:20.695775] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D2] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:21.050012] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF9A] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.077444] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF9A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.077491] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF9A] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.077506] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF9A] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.077528] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF9A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.077625] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF9A] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.077638] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF9A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.078001] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF7D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.106550] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF7D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.106584] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF7D] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.106594] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF7D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.106617] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF7D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.106699] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF7D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.106712] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF7D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.109235] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFC2] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.137939] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFC2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.138011] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFC2] [lt=70] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.138022] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFC2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.138045] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFC2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.138163] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFC2] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.138180] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFC2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.138209] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=11] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:21.138234] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:21.138305] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=14] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:21.139148] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=24] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:21.139437] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=37] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:21.140294] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:21.140306] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:21.140515] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:21.141485] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:21.141493] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:21.141687] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:21.141698] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:21.141706] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:21.141886] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=98] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:21.141896] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] broadcast root address succeed [2024-01-03 18:06:21.143382] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:21.143413] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=15] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:21.143424] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:21.145911] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:21.148306] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=102] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:21.152976] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF5] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.153587] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF6] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:21.154370] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF7] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.154909] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF8] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:21.155456] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF9] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.156009] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFA] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:21.156593] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CFB] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.378401] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:21.378410] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:21.431690] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:21.431721] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:21.431730] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:21.454708] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:21.454746] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:21.454758] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:21.454774] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:06:21.487991] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=71] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:21.504168] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AC] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.504561] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AD] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.504985] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AE] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.580431] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:21.580441] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:21.580452] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=138) [2024-01-03 18:06:21.580461] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:21.580468] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:21.580476] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=571762088) [2024-01-03 18:06:21.580495] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:21.580503] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:21.580537] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFC5] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:21.580677] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFC5] [lt=20] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:21.815414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C17] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.816157] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C18] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:21.816733] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C19] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.817316] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:21.817860] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C1B] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.818392] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:21.818882] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C1D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:22.077782] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB6] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.107115] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.107153] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB6] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.107163] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.107186] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.107249] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF9D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.107287] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB6] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.107299] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.138120] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.138158] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF9D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.138168] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.138190] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF9D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.138311] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF9D] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.138324] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.138343] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF80] [lt=41] [dc=1] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.153742] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:22.153758] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=14] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:22.153767] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:22.153782] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994471] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=67, ddl_arg=NULL) [2024-01-03 18:06:22.167111] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF80] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.167158] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF80] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.167168] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF80] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.167204] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF80] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.167337] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF80] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.167358] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF80] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.434352] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:22.434387] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:22.434399] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:22.490590] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:22.490639] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276382153716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-753, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:22.490660] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:22.492433] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:22.492502] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276381454679, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-912, last_round_trip_time:878, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:22.492540] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:22.571613] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:22.571668] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:22.571685] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:22.571706] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=135, ddl_arg=NULL) [2024-01-03 18:06:23.107467] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF81] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.138536] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF81] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.138575] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF81] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.138592] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF81] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.138626] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF81] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.138685] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFC8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.138776] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF81] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.138797] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF81] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.157564] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF1-00060E079C528CFC] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.158251] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFD] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:06:23.158878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CFE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.159482] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFF] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:23.159976] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D00] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.160449] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D01] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:23.160923] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D02] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.165938] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFC8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.165972] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFC8] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.165981] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFC8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.166016] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFC8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.166103] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFC8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.166116] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFC8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.167538] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.194849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB9] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.194883] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB9] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.194893] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.194917] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.195047] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB9] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.195060] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.437006] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:23.437038] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:23.437047] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:23.455703] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:23.455754] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:23.455766] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:23.455783] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:23.493175] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:23.493226] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276382153716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-753, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:23.493256] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:23.494922] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:23.494994] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276383455660, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-964, last_round_trip_time:868, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:23.495024] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:23.505770] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AF] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.506333] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B0] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.506834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B1] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.507418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B2] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.819842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF2-00060E079EC94C1E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.820567] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1F] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:23.821237] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C20] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.821835] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C21] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:23.822447] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C22] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.823031] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C23] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:23.823566] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C24] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:24.138981] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.154760] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:24.154817] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:24.154828] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:24.154844] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994472] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=121, ddl_arg=NULL) [2024-01-03 18:06:24.166908] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.166933] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFBA] [lt=24] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.166942] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFBA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.167057] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFBA] [lt=96] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.167116] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFA2] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.167201] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFBA] [lt=58] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.167214] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.197799] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFA2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.197833] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFA2] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.197843] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFA2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.197866] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFA2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.197925] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.197999] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFA2] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.198011] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFA2] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.225266] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF84] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.225299] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF84] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.225309] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF84] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.225332] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.225426] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF84] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.225439] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.331091] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:24.439424] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:24.439466] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:24.439481] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:24.495900] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:24.496013] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276384154728, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-650, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:24.496048] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:24.497977] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=51] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:24.498021] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276383455660, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-964, last_round_trip_time:868, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:24.498042] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:24.572692] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:24.572730] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:24.572741] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:24.572758] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:06:24.972936] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF9] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.167383] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF85] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.198096] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF85] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.198143] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF85] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.198154] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF85] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.198178] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF85] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.198225] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFCD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.198280] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF85] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.198298] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF85] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.229540] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFCD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.229583] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFCD] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.229597] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFCD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.229631] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFCD] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.229701] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFBD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.229790] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFCD] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.229809] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFCD] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.261635] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFBD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.261661] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFBD] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.261674] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFBD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.261706] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFBD] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.261818] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFBD] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.261830] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFBD] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.261850] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:25.261867] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:25.261910] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:25.262608] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=11] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:25.262842] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:25.263764] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:25.263776] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:25.264131] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=18] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:25.265180] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=35] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:25.265191] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:25.265477] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:25.265507] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=27] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:25.265519] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:25.265619] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:25.265646] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=25] [dc=0] broadcast root address succeed [2024-01-03 18:06:25.267122] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:25.267181] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:25.267205] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:25.269691] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:25.271286] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:25.307203] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D04] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.307913] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D05] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:06:25.308596] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D06] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.309295] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D07] [lt=73] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.310304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D08] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.311078] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D09] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.311806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0A] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.442566] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:25.442596] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:25.442605] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:25.456891] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:25.456910] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:25.456921] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:25.456938] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=80, ddl_arg=NULL) [2024-01-03 18:06:25.498839] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:25.498897] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276384154728, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-650, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:25.498934] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:25.500800] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:25.500885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276385456860, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:855, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:25.500926] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:25.508255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B3] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.508895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B4] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.509437] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B5] [lt=83] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.509864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B6] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.586119] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:25.586129] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:25.696651] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D3] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.794276] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:25.794286] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:25.794294] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=139) [2024-01-03 18:06:25.794300] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:25.794305] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=3] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:25.794310] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=575975923) [2024-01-03 18:06:25.794326] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:25.794333] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:25.794363] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DFC0] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:25.981782] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF2-00060E079EC94C26] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.982757] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C27] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=29, ddl_arg=NULL) [2024-01-03 18:06:25.983457] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C28] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.984240] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C29] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=28, ddl_arg=NULL) [2024-01-03 18:06:25.984816] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2A] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.985461] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C2B] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:25.986050] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2C] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:26.156060] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=26] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:26.156101] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:26.156113] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:26.156130] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994473] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:06:26.198429] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFA7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.229024] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFA7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.229072] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFA7] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.229087] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFA7] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.229122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFA7] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.229257] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFA7] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.229275] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFA7] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.229999] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF88] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.262866] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF88] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.262893] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF88] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.262902] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF88] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.262941] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF88] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.263025] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD0] [lt=25] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.263063] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF88] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.263075] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF88] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.292768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD0] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.292803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD0] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.292819] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD0] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.292852] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.292969] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD0] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.292983] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.445282] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:26.445311] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:26.445320] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:26.503591] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:26.503691] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276386156027, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-510, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:26.503744] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=47] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:26.504134] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:26.504187] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276385456860, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:855, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:26.504199] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:26.505049] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.505109] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.505133] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.573829] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:26.573903] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:26.573922] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:26.573943] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=154, ddl_arg=NULL) [2024-01-03 18:06:27.229542] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD1] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.263079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.263117] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.263128] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD1] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.263152] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.263250] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD1] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.263263] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.263230] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.291466] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFC3] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.291502] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFC3] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.291512] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFC3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.291535] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.291633] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFC3] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.291646] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.293123] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAA] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.312795] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0B] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.313532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D0C] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:27.314372] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.315388] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D0E] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:27.316277] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF1-00060E079C528D0F] [lt=54] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.317027] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D10] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:27.317636] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D11] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.323249] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.323289] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAA] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.323299] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.323329] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.323457] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAA] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.323475] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAA] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.448416] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:27.448444] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:27.448453] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:27.458162] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=30] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:27.458201] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:27.458217] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:27.458237] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:06:27.506669] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:27.506744] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276386156027, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-510, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:27.506764] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:27.507061] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:27.507164] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=45] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276387458106, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-821, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:27.507196] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:27.510706] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B8] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.511471] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B9] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.511988] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BA] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.512547] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.987177] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2D] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.988123] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C2E] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:27.988905] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF2-00060E079EC94C2F] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.989582] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C30] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:27.990249] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C31] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.990962] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C32] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:27.991607] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C33] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:28.157115] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:28.157154] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:28.157166] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:28.157183] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994474] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:28.263405] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAB] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.294546] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.294564] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAB] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.294574] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.294596] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.294687] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF8D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.294765] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAB] [lt=69] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.294783] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAB] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.322527] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF8D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.322562] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF8D] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.322576] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF8D] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.322599] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.322692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF8D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.322704] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF8D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.323615] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.353278] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD4] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.353301] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD4] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.353314] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD4] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.353337] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.353440] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD4] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.353452] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD4] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.450833] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:28.450861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:28.450870] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:28.509232] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=55] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:28.509283] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276388157084, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:28.509331] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:28.509464] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:28.509506] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276387458106, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-821, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:28.509532] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:28.574833] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:28.574867] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:28.574880] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:28.574897] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:29.294927] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.318577] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D12] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.319498] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D13] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:06:29.320267] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D14] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.320993] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D15] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:29.321570] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D16] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.322106] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D17] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:29.322697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D18] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.325378] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.325405] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD5] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.325415] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.325438] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.325505] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.325546] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD5] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.325559] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.332013] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844E] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:29.352325] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFC8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.352373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFC8] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.352383] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFC8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.352407] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.352496] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFC8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.352509] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.353597] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.380432] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.380469] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAE] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.380478] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.380501] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.380601] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAE] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.380614] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.380634] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:29.380652] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:29.380696] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:29.381377] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:29.381574] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:29.382487] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:29.382500] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:29.382802] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:29.383700] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:29.383711] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:29.384095] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:29.384112] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:29.384141] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=25] [dc=0] start to process rs list update task [2024-01-03 18:06:29.384281] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=30] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:29.384294] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:06:29.386248] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:29.386311] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:29.386344] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=30] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:29.388869] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=10] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:29.390480] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=42] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:29.453612] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:29.453644] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:29.453655] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:29.459359] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:29.459395] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:29.459406] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:29.459422] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:29.512253] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:29.512313] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276388157084, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:29.512326] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:29.512363] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:29.512425] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276389459332, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-974, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:29.512464] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:29.513435] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BC] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514031] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BD] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514937] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BF] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.636240] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=17] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:29.636281] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=34] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:29.829560] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:29.829568] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:29.829578] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=140) [2024-01-03 18:06:29.829584] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:29.829590] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:29.829596] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=580011209) [2024-01-03 18:06:29.829617] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:29.829623] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:29.973657] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFA] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:29.992617] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C34] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.993311] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C35] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:29.993913] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C36] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.994459] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C37] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:29.995027] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C38] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.995591] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C39] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:29.996047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3A] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:30.026872] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=32] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:06:30.158174] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:30.158214] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:30.158249] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=32] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:30.158266] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994475] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:06:30.325709] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.357555] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF92] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.357589] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF92] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.357599] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF92] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.357623] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.357686] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.357726] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF92] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.357739] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.387630] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD8] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.387699] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD8] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.387717] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD8] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.387755] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD8] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.387881] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.388006] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD8] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.388031] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD8] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.417036] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.417073] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFCB] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.417083] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFCB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.417105] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFCB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.417228] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFCB] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.417242] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.456424] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:30.456455] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:30.456464] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:30.514775] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:30.514825] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276389459332, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-974, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:30.514861] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:30.515165] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:30.515229] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276390158143, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-657, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:30.515242] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:30.575589] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=19] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:30.575630] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:30.575641] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:30.575658] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:30.697487] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D4] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:31.323712] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D1A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.324535] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1B] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:06:31.325113] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528D1C] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.325716] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1D] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:31.326300] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D1E] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.326897] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1F] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:31.327363] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D20] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.357905] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.391200] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFCC] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.391222] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFCC] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.391231] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFCC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.391255] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.391333] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.391377] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFCC] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.391390] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.418768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB4] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.418803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB4] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.418814] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.418849] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB4] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.418911] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDB] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.418993] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB4] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.419006] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.444888] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.444921] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDB] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.444931] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.444991] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.445083] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDB] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.445096] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.458742] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:31.458770] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:31.458779] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:31.460468] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:31.460507] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:31.460518] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:31.460534] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:06:31.517840] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:31.517890] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276390158143, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-657, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:31.517906] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:31.518113] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:31.518157] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276391460401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-944, last_round_trip_time:894, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:31.518182] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:31.673453] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=32] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.673530] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=43] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.673576] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.674585] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C1] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.675151] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C2] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.675641] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C3] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.676080] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C4] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.996935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3C] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.997729] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C3D] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:31.998397] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3E] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.999068] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C3F] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:31.999568] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C40] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.999978] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C41] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:32.000485] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C42] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:32.159262] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:32.159301] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:32.159317] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:32.159332] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994476] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:32.391528] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.423001] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDC] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.423038] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDC] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.423048] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.423070] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.423125] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF97] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.423164] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDC] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.423178] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDC] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.452156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.452195] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF97] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.452240] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF97] [lt=43] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.452264] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.452322] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB7] [lt=17] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.452418] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF97] [lt=60] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.452432] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.461317] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:32.461340] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=18] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:32.461349] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:32.480932] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB7] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.481008] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB7] [lt=71] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.481021] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.481051] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.481142] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB7] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.481154] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB7] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.520653] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:32.520704] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276391460401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-944, last_round_trip_time:894, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:32.520740] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:32.521035] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:32.521125] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276392159231, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:32.521169] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:32.576525] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:32.576591] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:32.576602] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:32.576619] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:33.328336] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF1-00060E079C528D21] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.329038] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D22] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:33.329884] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D23] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.330569] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D24] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:33.331124] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D25] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.331601] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D26] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:33.332197] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D27] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.423291] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD1] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.455664] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD1] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.455692] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD1] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.455701] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.455725] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.455805] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.455847] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD1] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.455867] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD1] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.461762] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:33.461799] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:33.461810] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:33.461826] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:33.463893] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:33.463927] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:33.463937] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:33.485156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB8] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.485195] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB8] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.485205] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.485232] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB8] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.485314] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDF] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.485401] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB8] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.485415] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.485456] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=16] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:33.485481] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=11] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:33.485575] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=16] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:33.486590] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:33.486833] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:33.487823] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:33.487831] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:33.488049] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=46] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:33.489032] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:33.489043] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:33.489227] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:33.489247] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=18] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:33.489255] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:33.489333] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:33.489347] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:06:33.490610] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:33.490666] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:33.490689] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=21] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:33.493015] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:33.494430] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:33.516152] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDF] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.516202] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDF] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.516217] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDF] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.516248] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDF] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.516351] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDF] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.516364] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDF] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.523366] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:33.523379] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:33.523414] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276392159231, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:33.523420] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276393461704, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-842, last_round_trip_time:885, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:33.523426] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:33.523433] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:33.676908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.677414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C6] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.678051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C7] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.678603] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C8] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.715484] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:33.715494] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:33.893197] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:33.893207] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:33.893217] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=141) [2024-01-03 18:06:33.893224] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:33.893230] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:33.893236] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=584074849) [2024-01-03 18:06:33.893261] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:33.893275] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:33.893298] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DFBB] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:33.893409] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DFBB] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:34.002272] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C44] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:34.002869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C45] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.003481] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C46] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:34.004062] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C47] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.004538] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C48] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:34.005081] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C49] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.160304] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:34.160340] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:34.160350] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:34.160366] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994477] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=93, ddl_arg=NULL) [2024-01-03 18:06:34.332858] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844F] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:34.456075] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE0] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.466706] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:34.466735] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:34.466745] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:34.488092] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.488146] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE0] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.488161] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.488198] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.488285] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.488329] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE0] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.488343] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.518211] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD4] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.518249] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD4] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.518259] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.518293] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD4] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.518374] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFBC] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.518448] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD4] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.518467] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD4] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.526104] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:34.526164] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:34.526197] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276394160277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-717, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:34.526206] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276393461704, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-842, last_round_trip_time:885, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:34.526219] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:34.526219] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:34.551040] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFBC] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.551080] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFBC] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.551090] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFBC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.551115] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFBC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.551212] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFBC] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.551226] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFBC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.577535] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:34.577572] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:34.577583] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:34.577600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:34.974355] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFB] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:35.459107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D29] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.459698] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2A] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=26, ddl_arg=NULL) [2024-01-03 18:06:35.460270] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2B] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.460932] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2C] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:35.461460] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2D] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.461939] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2E] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:35.462451] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2F] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.462974] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:35.463006] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=29] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:35.463016] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:35.463032] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:06:35.469398] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:35.469426] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:35.469436] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:35.488494] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.519900] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.519934] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE3] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.519944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.519987] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE3] [lt=26] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.520062] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFA2] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.520161] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE3] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.520177] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE3] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.528488] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:35.528540] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276395462926, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1015, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:35.528552] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:35.528657] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:35.528699] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276394160277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-717, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:35.528725] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:35.553197] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFA2] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.553241] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFA2] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.553251] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFA2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.553274] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFA2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.553361] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.553459] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFA2] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.553474] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFA2] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.583283] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE4] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.583301] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.583311] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.583336] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.583445] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.583467] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE4] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.679371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C9] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.679859] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CA] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.680324] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E0CB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.680747] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CC] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.698314] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:36.139713] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4B] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.140471] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C4C] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:36.141258] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4D] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.141937] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C4E] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:36.142556] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4F] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.143164] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C50] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:36.143751] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C51] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.161319] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=15] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:36.161373] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:36.161389] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:36.161406] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994478] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:06:36.471936] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:36.471985] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:36.471995] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:36.520343] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.531283] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:36.531337] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:36.531337] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276396161288, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-768, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:36.531350] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:36.531394] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276395462926, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1015, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:36.531414] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:36.552426] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.552464] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD9] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.552474] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.552500] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.552609] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD9] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.552632] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD9] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.553620] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFC1] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.578431] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:36.578471] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:36.578483] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:36.578501] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:36.583573] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFC1] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.583624] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFC1] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.583641] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFC1] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.583673] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFC1] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.583756] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.583796] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFC1] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.583809] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFC1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.615493] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE7] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.615512] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE7] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.615521] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.615545] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.615656] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE7] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.615670] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.674975] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=67] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:36.675037] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=37] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:36.675053] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:37.463466] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D30] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.463850] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:37.463885] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:37.463894] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:37.463911] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=94, ddl_arg=NULL) [2024-01-03 18:06:37.464366] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D31] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:37.464898] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D32] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.465457] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D33] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:37.466051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D34] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.466603] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D35] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:37.467110] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D36] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.474527] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:37.474557] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:37.474567] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:37.533880] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:37.533891] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:37.533940] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276396161288, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-768, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:37.533970] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276397463821, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-973, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:37.533974] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:37.533983] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:37.534004] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:37.534018] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:37.534065] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:37.534934] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:37.535158] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:37.536068] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:37.536083] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:37.536296] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:37.537139] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:37.537147] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:37.537335] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:37.537359] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:37.537370] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:37.537455] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:37.537478] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:06:37.539254] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:37.539340] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=56] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:37.539370] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=27] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:37.542196] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:37.543920] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:37.552798] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.584346] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.584384] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE8] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.584394] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.584416] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.584481] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFA7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.584519] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE8] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.584533] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.616099] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFA7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.616123] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFA7] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.616132] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFA7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.616155] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFA7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.616265] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFA7] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.616280] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFA7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.616233] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFDC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.645713] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFDC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.645755] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFDC] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.645770] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFDC] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.645805] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFDC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.645966] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFDC] [lt=48] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.645994] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFDC] [lt=20] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.681757] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CE] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.682342] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CF] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.682882] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D0] [lt=73] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.683397] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D1] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.792893] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:37.792904] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:38.005259] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:38.005279] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=16] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:38.005292] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=142) [2024-01-03 18:06:38.005301] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:38.005308] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:38.005316] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=588186928) [2024-01-03 18:06:38.005350] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:38.005366] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=14] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:38.005396] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DFC6] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:38.005518] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DFC6] [lt=15] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:38.144615] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C52] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.145458] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C53] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:06:38.146272] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF2-00060E079EC94C54] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.146906] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C55] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:38.147504] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C56] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.148064] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C57] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:38.148616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C58] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.162517] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:38.162555] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:38.162571] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:38.162587] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994479] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:06:38.477096] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:38.477132] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:38.477142] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:38.536313] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=53] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:38.536366] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276398162485, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-767, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:38.536379] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:38.536462] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:38.536535] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276397463821, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-973, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:38.536563] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:38.579415] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:38.579455] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:38.579473] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:38.579499] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:06:38.584691] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFC7] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.614341] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFC7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.614378] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFC7] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.614388] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFC7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.614411] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFC7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.614516] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFC7] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.614530] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFC7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:38.616424] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.643430] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFEB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.643466] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFEB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.643474] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.643499] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.643583] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFEB] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.643597] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:38.646178] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAA] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.681931] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.681976] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAA] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.681991] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAA] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.682023] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAA] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.682137] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAA] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.682151] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.333700] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428450] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:39.465012] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=31] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:39.465059] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:39.465071] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:39.465088] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=111, ddl_arg=NULL) [2024-01-03 18:06:39.468079] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF1-00060E079C528D37] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.468841] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D38] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:39.469637] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D39] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.470245] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D3A] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:39.470819] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.471310] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D3C] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:39.471797] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.479912] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:39.479942] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:39.479983] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:39.539138] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:39.539218] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276398162485, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-767, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:39.539239] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:39.539273] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:39.539315] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276399464980, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-737, last_round_trip_time:863, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:39.539327] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:39.614698] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAB] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.646817] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAB] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.646857] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAB] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.646868] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.646892] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.646978] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE1] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.647019] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAB] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.647033] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.676150] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE1] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.676188] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.676198] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.676221] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.676324] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE1] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.676338] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.682325] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.684265] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D2] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.684733] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D3] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.685187] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D4] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.685634] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D5] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.711928] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCA] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.711977] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCA] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.711987] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCA] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.712016] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCA] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.712161] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCA] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.712178] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCA] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.975093] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFC] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:40.149561] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.150183] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5A] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:40.150775] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5B] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.151346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5C] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:40.151845] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5D] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.152375] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5E] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:40.152901] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.163488] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:40.163525] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:40.163536] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:40.163552] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:40.482565] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:40.482595] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:40.482604] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:40.541582] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:40.541652] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276400163458, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-764, last_round_trip_time:850, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:40.541697] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:40.541990] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=72] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:40.542034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276399464980, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-737, last_round_trip_time:863, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:40.542076] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:40.580526] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:40.580566] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:40.580578] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:40.580594] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:40.647200] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.679220] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCB] [lt=19] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.679259] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCB] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.679269] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.679293] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.679358] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.679428] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCB] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.679442] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:40.699095] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D6] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:40.714634] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF0] [lt=33] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.714676] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF0] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.714690] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.714724] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF0] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.714805] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.714855] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF0] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.714878] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF0] [lt=15] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:40.744737] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.744801] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAE] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.744814] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAE] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.744838] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.744939] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAE] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.744972] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAE] [lt=26] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.466187] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:41.466235] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:41.466247] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:41.466263] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:06:41.472650] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3F] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.473293] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D40] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:41.473921] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D41] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.474572] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D42] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:41.475296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D43] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.476025] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D44] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:41.476610] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D45] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.484905] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:41.484934] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:41.484943] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:41.544157] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:41.544213] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276400163458, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-764, last_round_trip_time:850, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:41.544238] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:41.544842] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:41.544923] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276401466157, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:879, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:41.544936] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:41.544988] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=12] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:41.545005] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:41.545107] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=62] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:41.545862] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:41.546074] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:41.547088] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:41.547097] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:41.547281] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:41.548120] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:41.548127] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:41.548311] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:41.548333] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:41.548341] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:41.548421] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:41.548442] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:06:41.549766] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:41.549813] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=30] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:41.549823] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:41.552233] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:41.553755] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=37] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:41.679594] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAF] [lt=56] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.710255] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.710289] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAF] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.710300] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.710333] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAF] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.710464] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAF] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.710477] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAF] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.715036] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE6] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.743127] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE6] [lt=6] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.743168] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE6] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.743180] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE6] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.743204] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.743289] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE6] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.743302] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.745183] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.776505] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCE] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.776540] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCE] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.776552] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCE] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.776574] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.776664] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCE] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.776680] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.812919] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:41.812933] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:41.826565] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.826624] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.826639] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.827531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D7] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D8] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D9] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828788] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DA] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.035094] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=27] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:42.035105] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:42.035117] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=143) [2024-01-03 18:06:42.035126] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:42.035134] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:42.035142] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=592216755) [2024-01-03 18:06:42.035168] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:42.035188] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=18] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:42.035226] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFF5] [lt=11] [dc=0] start to process rs list update task [2024-01-03 18:06:42.035365] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFF5] [lt=22] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:42.153835] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C61] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.154542] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C62] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:42.155188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C63] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.155679] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C64] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:42.156160] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF2-00060E079EC94C65] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.156764] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C66] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:42.157319] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C67] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.164455] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:42.164492] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:42.164507] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:42.164523] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:42.487570] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:42.487599] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:42.487609] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:42.547348] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:42.547400] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276402164425, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:42.547413] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:42.547760] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:42.547802] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276401466157, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:879, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:42.547814] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:42.581530] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:42.581576] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:42.581594] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:42.581618] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:06:42.710618] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF6] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.740878] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF6] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.740912] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF6] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.740922] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.740964] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.741057] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF6] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.741071] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:42.743457] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFB2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.772768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFB2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.772803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFB2] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.772813] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFB2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.772836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFB2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.772919] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFB2] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.772932] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFB2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:42.776792] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.807968] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE9] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.808013] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE9] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.808028] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.808060] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE9] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.808238] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE9] [lt=66] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.808260] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE9] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.467314] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:43.467352] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:43.467363] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:43.467379] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:06:43.477555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D46] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.478216] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D47] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:43.478910] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D48] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.479459] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D49] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:43.479974] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4A] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.480473] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D4B] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:43.481071] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4C] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.490123] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:43.490153] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:43.490162] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:43.549965] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=49] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:43.550016] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276402164425, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:43.550034] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:43.550198] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:43.550241] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276403467285, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-917, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:43.550267] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:43.741221] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFEA] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.775004] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFEA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.775038] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFEA] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.775047] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFEA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.775070] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFEA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.775127] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFD3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.775167] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFEA] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.775179] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFEA] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.804337] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFD3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.804373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFD3] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.804383] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFD3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.804407] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFD3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.804502] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFD3] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.804515] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFD3] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.808436] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF9] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.829893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DB] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.830533] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DC] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.831073] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DD] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.831507] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DE] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.838322] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF9] [lt=35] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.838371] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF9] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.838385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.838408] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.838528] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF9] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.838541] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.158304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C68] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.159041] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C69] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:44.159694] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C6A] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.160326] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C6B] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:44.160868] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C6C] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.161416] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C6D] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:44.161884] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94C6E] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.165393] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:44.165431] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:44.165442] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:44.165459] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:44.334628] INFO [RS] ob_rs_rpc_processor.h:196 [2022][492][YB42C0A86EF1-00060E079C428451] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:44.492608] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=92] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:44.492655] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=41] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:44.492664] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:44.552442] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:44.552474] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:44.552493] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276404165362, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:44.552508] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:44.552517] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276403467285, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-917, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:44.552530] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:44.582425] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:44.582488] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:44.582501] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:44.582518] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:06:44.775328] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFFA] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.805366] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFFA] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.805403] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFFA] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.805412] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFFA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.805437] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFFA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.805509] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.805557] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFFA] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.805571] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFFA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.835624] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.835679] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFB7] [lt=51] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.835693] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFB7] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.835717] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFB7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.835818] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFB7] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.835833] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.838692] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.868526] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFED] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.868544] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFED] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.868552] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.868577] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.868694] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFED] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.868717] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFED] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.975699] INFO [RS] ob_rs_rpc_processor.h:196 [2015][478][YB42C0A86EF0-00060E079A24DAFD] [lt=86] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:45.468367] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:45.468405] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:45.468416] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:45.468434] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:06:45.495026] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:45.495045] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:45.495055] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:45.554981] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:45.555033] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276405468306, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:884, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:45.555038] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:45.555045] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:45.555081] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276404165362, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:45.555099] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:45.555119] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:45.555134] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:45.555199] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:45.555986] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=44] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:45.556191] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=16] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:45.557132] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=14] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:45.557146] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:45.557351] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:45.558178] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:45.558184] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:45.558360] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:45.558372] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=10] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:45.558380] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:45.558463] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:45.558471] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:06:45.560114] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:45.560169] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:45.560180] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:45.562564] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:45.564187] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:45.622350] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4E] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.623091] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D4F] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:45.623779] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D50] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.624317] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D51] [lt=77] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:45.624801] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D52] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.625277] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D53] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:45.625749] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D54] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.699887] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D7] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:45.804508] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:45.804533] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=20] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:45.805737] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFEE] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.832480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF0-00060E079A34E0DF] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.833107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E0] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.833610] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E1] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.834221] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E2] [lt=67] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.837143] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFEE] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.837182] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFEE] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.837192] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFEE] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.837216] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFEE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.837319] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFD8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.837340] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFEE] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.837355] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFEE] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:45.873158] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFD8] [lt=46] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.873198] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFD8] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.873208] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFD8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.873241] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFD8] [lt=15] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.873318] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.873444] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFD8] [lt=98] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.873460] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFD8] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:45.903844] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBA] [lt=98] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.903878] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBA] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.903895] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBA] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.903930] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBA] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.904067] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBA] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.904082] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBA] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.011742] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:46.011756] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:46.011768] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=144) [2024-01-03 18:06:46.011781] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:46.011790] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:46.011798] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=596193410) [2024-01-03 18:06:46.011827] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:46.011835] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:46.011866] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFFF] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:46.012055] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFFF] [lt=35] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:46.166460] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:46.166508] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:46.166521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:46.166538] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:06:46.300458] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C70] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.301212] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C71] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:46.301922] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C72] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.302513] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C73] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:46.303033] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C74] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.303548] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C75] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:46.304076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C76] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.497499] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:46.497528] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:46.497538] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:46.557427] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:46.557441] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:46.557478] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276406166388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:46.557483] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276405468306, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:884, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:46.557491] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:46.557495] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:46.583303] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:46.583343] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:46.583354] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:46.583395] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:06:46.828050] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.828116] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.828134] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.837499] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E000] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.866940] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E000] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.866994] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E000] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.867004] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E000] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.867028] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E000] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.867132] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E000] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.867148] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E000] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.873618] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.903387] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFF1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.903425] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFF1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.903439] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFF1] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.903464] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.903565] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFF1] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.903580] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.904256] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.938868] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBD] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.938907] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBD] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.938918] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.938942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.939059] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBD] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.939075] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.469533] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:47.469572] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:47.469584] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:47.469600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:47.500394] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:47.500423] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:47.500433] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:47.560359] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:47.560460] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276407469502, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-894, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:47.560475] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:47.560591] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:47.560648] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276406166388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:47.560665] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:47.626864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D55] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.627876] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D56] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=31, ddl_arg=NULL) [2024-01-03 18:06:47.628539] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D57] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.629229] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D58] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:47.629758] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.630469] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D5A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:47.631227] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D5B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.835079] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E4] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.835621] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.836049] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.836602] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E7] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.867288] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBE] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.897349] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBE] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.897367] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBE] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.897381] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBE] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.897406] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.897498] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBE] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.897513] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.903721] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFDD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.932142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFDD] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.932180] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFDD] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.932194] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFDD] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.932218] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFDD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.932343] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFDD] [lt=48] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.932356] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFDD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.939221] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.969457] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFF4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.969495] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFF4] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.969505] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFF4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.969530] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.969636] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFF4] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.969650] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:48.167508] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:48.167550] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:48.167565] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:48.167594] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:06:48.305011] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C77] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:48.305755] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C78] [lt=77] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:48.306615] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C79] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:48.307219] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C7A] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:48.307876] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C7B] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:48.308439] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C7C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:48.309050] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C7D] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:48.503930] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=54] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:48.503982] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=45] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:48.503997] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:48.562821] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:48.562870] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276407469502, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-894, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:48.562882] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:48.563382] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:48.563424] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276408167476, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-761, last_round_trip_time:795, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:48.563435] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:48.584249] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB93] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:48.584289] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB93] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:48.584300] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB93] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:48.584316] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB93] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:48.897664] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF5] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:48.929614] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFF5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:48.929653] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFF5] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:48.929663] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFF5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:48.929686] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFF5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:48.929791] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFF5] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:48.929804] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFF5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:48.932514] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E005] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:48.965309] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E005] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:48.965344] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E005] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:48.965354] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E005] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:48.965378] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E005] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:48.965495] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E005] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:48.965517] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E005] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:48.969770] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFC1] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:48.998145] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFC1] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:48.998180] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFC1] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:48.998194] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFC1] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:48.998217] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFC1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:48.998313] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFC1] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:48.998326] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFC1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:49.335436] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428452] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:49.470564] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:49.470602] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EF] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:49.470621] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EF] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:49.470645] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EF] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:06:49.506992] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=44] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:49.507025] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:49.507034] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:49.565237] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:49.565291] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276409470519, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-892, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:49.565327] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:49.565898] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:49.565943] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276408167476, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-761, last_round_trip_time:795, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:49.565980] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:49.565999] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:49.566028] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=20] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:49.566067] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:49.567004] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=59] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:49.567203] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:49.568191] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:49.568203] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:49.568387] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:49.569251] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:49.569257] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:49.569418] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:49.569426] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:49.569434] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:49.569511] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:49.569533] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:06:49.570755] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:49.570815] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:49.570840] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=23] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:49.573266] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:49.574693] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:49.632293] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF1-00060E079C528D5C] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.633121] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D5D] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:49.633827] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D5E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.634451] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D5F] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:49.634970] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D60] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.635567] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D61] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:49.636085] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528D62] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.824845] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:49.824860] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=11] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:49.837512] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E8] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.838043] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E9] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.838426] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0EA] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.838876] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0EB] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:49.929924] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFC2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:49.962538] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFC2] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:49.962555] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFC2] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:49.962564] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFC2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:49.962588] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFC2] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:49.962712] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFC2] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:49.962726] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFC2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:49.998463] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:50.054554] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:50.054565] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:50.054577] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=145) [2024-01-03 18:06:50.054585] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:50.054593] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:50.054601] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=600236213) [2024-01-03 18:06:50.054627] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:50.054648] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E009] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:50.054676] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E00A] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:50.054820] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E00A] [lt=22] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:50.095916] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079CB283CF] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:06:50.168720] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447F] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:50.168741] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447F] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:50.168755] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447F] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:50.168780] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447F] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:50.171229] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079F794359] [lt=57] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:50.310096] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C7E] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:50.310944] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C7F] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:50.311580] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C80] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:50.312279] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C81] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:50.312800] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C82] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:50.313328] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C83] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:50.313901] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C84] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:50.509524] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:50.509553] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:50.509562] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:50.568624] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:50.568677] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:50.568724] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276409470519, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-892, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:50.568740] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276410168691, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:50.568755] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:50.568756] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:50.585094] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB94] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:50.585132] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB94] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:50.585146] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB94] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:50.585163] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB94] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:50.700870] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D8] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:50.962871] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E00B] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:50.995330] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E00B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:50.995364] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E00B] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:50.995373] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E00B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:50.995396] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E00B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:50.995494] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E00B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:50.995507] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E00B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:50.996918] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFC5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:51.027944] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFC5] [lt=46] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:51.028014] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFC5] [lt=68] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:51.028023] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFC5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:51.028047] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFC5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:51.028146] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFC5] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:51.028159] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFC5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:51.030930] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFE5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:51.061042] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFE5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:51.061093] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFE5] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:51.061108] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFE5] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:51.061134] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFE5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:51.061357] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFE5] [lt=86] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:51.061386] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFE5] [lt=20] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:51.471698] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:51.471738] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F0] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:51.471750] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F0] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:51.471768] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:06:51.511902] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:51.511931] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:51.511940] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:51.571224] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:51.571240] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:51.571274] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276411471667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-867, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:51.571282] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276410168691, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:51.571346] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=67] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:51.571353] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=58] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:51.637189] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF1-00060E079C528D64] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:51.637931] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D65] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:51.638522] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D66] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:51.639077] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D67] [lt=52] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:51.639571] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D68] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:51.640028] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D69] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:51.640503] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D6A] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:51.995675] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFE6] [lt=19] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:52.016671] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=83] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:52.016797] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=93] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:52.016824] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=13] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:52.018180] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0ED] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.018673] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0EE] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.019090] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0EF] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.019463] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F0] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.030590] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFE6] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:52.030624] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFE6] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:52.030633] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFE6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:52.030657] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFE6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:52.030747] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFFD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:52.030765] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFE6] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:52.030777] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFE6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:52.058452] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFFD] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:52.058488] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFFD] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:52.058497] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFFD] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:52.058520] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFFD] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:52.058623] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFFD] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:52.058636] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFFD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:52.061598] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E00E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:52.092428] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E00E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:52.092470] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E00E] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:52.092484] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E00E] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:52.092515] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E00E] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:52.092647] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E00E] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:52.092665] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E00E] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:52.169777] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994480] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:52.169816] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994480] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:52.169827] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994480] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:52.169843] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994480] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:52.314866] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C86] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.315669] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C87] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:52.316392] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C88] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.317111] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C89] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:52.317725] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C8A] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.318325] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C8B] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:52.319036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2003][454][YB42C0A86EF2-00060E079EC94C8C] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:52.515891] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:52.515915] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:52.515925] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:52.573868] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:52.573920] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276412169747, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-816, last_round_trip_time:790, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:52.573932] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:52.574113] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:52.574155] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276411471667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-867, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:52.574167] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:52.585977] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB95] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:52.585997] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB95] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:52.586020] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB95] [lt=20] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:52.586038] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB95] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:06:53.030909] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E00F] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:53.061120] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E00F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:53.061157] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E00F] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:53.061167] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E00F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:53.061190] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E00F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:53.061253] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFCA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:53.061302] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E00F] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:53.061315] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E00F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:53.091636] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFCA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:53.091672] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFCA] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:53.091682] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFCA] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:53.091707] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFCA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:53.091802] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFCA] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:53.091817] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFCA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:53.092804] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E000] [lt=42] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:53.123282] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E000] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:53.123317] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E000] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:53.123327] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E000] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:53.123351] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E000] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:53.123451] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E000] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:53.123465] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E000] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:53.123486] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:53.123503] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:53.123573] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=27] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:53.124509] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=33] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:53.124695] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:53.125539] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:53.125546] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:53.125717] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:53.126669] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:53.126675] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:53.126856] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:53.126877] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:53.126885] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:53.126994] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=51] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:53.127008] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=12] [dc=0] broadcast root address succeed [2024-01-03 18:06:53.128302] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:53.128359] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:53.128370] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:53.130630] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=14] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:53.132129] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=37] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:53.390074] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:53.390086] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:53.472696] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F1] [lt=47] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:53.472716] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F1] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:53.472727] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:53.472745] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F1] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=84, ddl_arg=NULL) [2024-01-03 18:06:53.519512] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:53.519553] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:53.519570] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:53.607598] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:53.607613] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=12] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:53.607626] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=8] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=146) [2024-01-03 18:06:53.607634] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:53.607643] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:53.607651] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=603789263) [2024-01-03 18:06:53.607677] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:53.607698] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E002] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:53.607725] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E003] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:06:53.607879] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E003] [lt=20] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:53.641456] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D6B] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:53.642120] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D6C] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:53.642690] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D6D] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:53.643216] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D6E] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:53.643723] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D6F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:53.644225] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D70] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:06:53.644697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D71] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.020226] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F1] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.020844] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F2] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.021335] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F3] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.021781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F4] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.061467] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFEB] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:54.095086] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFEB] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:54.095123] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFEB] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:54.095139] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFEB] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:54.095174] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFEB] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:54.095257] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E012] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:54.095373] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFEB] [lt=85] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:54.095414] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFEB] [lt=31] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:54.125123] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E012] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:54.125140] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E012] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:54.125149] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E012] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:54.125172] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E012] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:54.125232] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFCD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:54.125286] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E012] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:54.125299] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E012] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:54.155308] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFCD] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:54.155349] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFCD] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:54.155364] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFCD] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:54.155398] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFCD] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:54.155544] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFCD] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:54.155565] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFCD] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:54.170736] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994481] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:54.170771] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994481] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:54.170781] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994481] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:54.170796] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994481] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:06:54.320192] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C8D] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.320868] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C8E] [lt=63] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:54.321464] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C8F] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.322000] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C90] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:54.322524] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C91] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.323065] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C92] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:54.323710] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C93] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:54.336235] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428453] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:54.521941] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:54.521986] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=40] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:54.521996] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:54.579415] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:54.579467] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:54.579487] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276413472664, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-976, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:54.579511] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276414170708, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-829, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:54.579518] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:54.579524] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:54.586939] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB96] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:54.586991] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB96] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:54.587000] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB96] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:54.587017] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB96] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:06:54.976940] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFF] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:55.095581] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFCE] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:55.126815] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFCE] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:55.126858] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFCE] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:55.126874] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFCE] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:55.126906] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFCE] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:55.127004] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E006] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:55.127037] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFCE] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:55.127052] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFCE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:55.158853] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E006] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:55.158900] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E006] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:55.158914] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E006] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:55.158970] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E006] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:55.159071] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E015] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:55.159152] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E006] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:55.159171] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E006] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:55.187299] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E015] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:55.187335] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E015] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:55.187345] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E015] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:55.187368] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E015] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:55.187471] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E015] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:55.187488] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E015] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:55.473524] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:55.473563] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F2] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:55.473575] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F2] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:55.473593] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F2] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:55.524512] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:55.524542] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:55.524552] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:55.582137] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:55.582189] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276415473494, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-951, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:55.582256] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=62] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:55.582279] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:55.582323] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276414170708, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-829, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:55.582336] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:55.701690] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D9] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:55.770923] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D73] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:55.771584] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D74] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:55.772175] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D75] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:55.772667] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D76] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:55.773143] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D77] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:55.773647] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D78] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:55.774188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D79] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.022707] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F5] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.023250] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F6] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.023644] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.024112] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0F8] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.127196] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E016] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:56.159467] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E016] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:56.159517] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E016] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:56.159534] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E016] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:56.159581] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E016] [lt=21] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:56.159652] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFF0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:56.159802] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E016] [lt=48] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:56.159830] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E016] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:56.171875] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994482] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:56.171907] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994482] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:56.171919] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994482] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:56.171974] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994482] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=146, ddl_arg=NULL) [2024-01-03 18:06:56.189496] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFF0] [lt=42] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:56.189545] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFF0] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:56.189559] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFF0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:56.189585] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFF0] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:56.189647] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFD1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:56.189703] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFF0] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:56.189715] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFF0] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:56.219721] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFD1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:56.219756] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFD1] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:56.219766] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFD1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:56.219790] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFD1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:56.219917] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFD1] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:56.219931] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFD1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:56.449563] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C95] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.450235] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF2-00060E079EC94C96] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:56.451022] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C97] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.451533] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C98] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:56.452070] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C99] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.452558] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C9A] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:56.453128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C9B] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:56.527123] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:56.527156] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:56.527165] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:56.585004] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=69] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:56.585054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276416171829, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-683, last_round_trip_time:786, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:56.585139] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=80] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:56.585558] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:56.585607] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276415473494, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-951, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:56.585634] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:56.587819] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB97] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:56.587863] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB97] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:56.587873] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB97] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:56.587889] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB97] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:57.018348] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:57.018418] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=37] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:57.018447] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=12] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:57.160041] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFD2] [lt=43] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:57.191134] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFD2] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:57.191173] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFD2] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:57.191183] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFD2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:57.191206] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFD2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:57.191267] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E00B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:57.191309] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFD2] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:57.191323] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFD2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:57.222438] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E00B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:57.222477] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E00B] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:57.222493] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E00B] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:57.222523] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E00B] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:57.222608] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFF3] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:57.222691] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E00B] [lt=57] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:57.222705] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E00B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:57.254854] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFF3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:57.254910] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFF3] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:57.254921] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFF3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:57.254963] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFF3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:57.255038] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFF3] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:57.255051] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFF3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:57.255074] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:57.255091] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:57.255148] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=11] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:57.255884] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=12] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:57.258147] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:57.259358] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=14] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:57.259367] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:57.259534] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:57.260311] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:57.260318] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:57.260477] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:57.260487] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:57.260495] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:57.260560] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=8] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:57.260570] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=9] [dc=0] broadcast root address succeed [2024-01-03 18:06:57.262056] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=37] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:57.262165] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=89] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:57.262183] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=16] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:57.265340] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=13] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:57.266891] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:57.474572] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:57.474611] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F3] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:57.474622] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F3] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:57.474640] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F3] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:06:57.529515] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:57.529551] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:57.529561] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:57.529619] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:57.529647] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=23] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:57.588122] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:57.588172] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276416171829, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-683, last_round_trip_time:786, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:57.588185] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:57.588295] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=58] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:57.588337] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276417474544, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-935, last_round_trip_time:820, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:57.588348] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:57.735287] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:57.735300] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=9] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:57.735311] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=147) [2024-01-03 18:06:57.735320] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:57.735328] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:57.735336] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=607916948) [2024-01-03 18:06:57.735362] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:57.735385] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFF5] [lt=21] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:57.735411] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DFF6] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:57.735536] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DFF6] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:57.775132] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D7A] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:57.775828] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D7B] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:57.776389] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D7C] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:57.776866] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D7D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:57.777356] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D7E] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:57.777796] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D7F] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:57.778267] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D80] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.025048] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FA] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.025672] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FB] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.026219] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FC] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.026653] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FD] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.173091] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994483] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:58.173134] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994483] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:58.173146] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994483] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:58.173162] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994483] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:06:58.191489] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E01B] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:58.224911] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E01B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:58.224996] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E01B] [lt=80] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:58.225013] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E01B] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:58.225042] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E01B] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:58.225143] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFD5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:58.225222] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E01B] [lt=66] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:58.225235] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E01B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:58.259281] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFD5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:58.259320] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFD5] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:58.259330] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFD5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:58.259353] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFD5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:58.259412] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E00E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:58.259458] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFD5] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:58.259472] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFD5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:58.288846] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E00E] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:58.288883] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E00E] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:58.288895] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E00E] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:58.288931] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E00E] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:58.289077] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E00E] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:58.289091] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E00E] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:58.454231] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C9C] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.455031] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C9D] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:58.455815] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C9E] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.456446] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C9F] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:58.456973] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA0] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.457426] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CA1] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:06:58.457865] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA2] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:58.532210] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:58.532238] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:58.532247] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:58.588541] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB98] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:58.588573] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB98] [lt=29] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:58.588583] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB98] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:58.588600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB98] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:06:58.590704] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:58.590754] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276418173056, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-775, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:58.590792] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:58.590808] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=49] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:58.590852] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276417474544, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-935, last_round_trip_time:820, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:58.590879] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:59.225392] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E00F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:59.255303] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E00F] [lt=105] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:59.255325] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E00F] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:59.255335] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E00F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:59.255360] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E00F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:59.255465] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E00F] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:59.255478] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E00F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:59.259640] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFF9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:59.290603] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFF9] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:59.290652] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFF9] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:59.290666] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFF9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:59.290702] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFF9] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:59.290772] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E01E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:59.290844] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFF9] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:59.290871] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFF9] [lt=19] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:59.319551] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E01E] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:59.319588] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E01E] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:59.319597] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E01E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:59.319620] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E01E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:59.319718] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E01E] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:59.319730] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E01E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:59.337111] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428454] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:59.475674] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F4] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:59.475722] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F4] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:59.475735] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F4] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:59.475755] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F4] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:06:59.534909] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:59.534928] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:59.534937] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:59.593238] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:59.593238] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:59.593284] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276418173056, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-775, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:59.593284] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276419475632, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:59.593297] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:59.593297] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:59.779298] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D81] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:59.780081] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D82] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:06:59.780775] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D83] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:59.781386] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D84] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:59.782029] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D85] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:59.782590] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D86] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:59.783083] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D87] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:59.977641] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB00] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:00.027420] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FE] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.027903] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0FF] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.028316] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E100] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.028686] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E101] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.174169] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994484] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:00.174207] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994484] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:00.174245] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994484] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:00.174262] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994484] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=145, ddl_arg=NULL) [2024-01-03 18:07:00.255663] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E01F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:00.289932] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E01F] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:00.289992] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E01F] [lt=57] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:00.290002] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E01F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:00.290027] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E01F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:00.290187] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E01F] [lt=44] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:00.290202] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E01F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:00.291032] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFDA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:00.320840] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFDA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:00.320876] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFDA] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:00.320886] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFDA] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:00.320911] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFDA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:00.320996] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E012] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:00.321036] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFDA] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:00.321051] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFDA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:00.349983] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E012] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:00.350018] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E012] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:00.350028] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E012] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:00.350052] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E012] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:00.350139] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E012] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:00.350152] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E012] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:00.458826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA3] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.459571] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CA4] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:07:00.460196] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA5] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.461004] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CA6] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:00.461667] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.462278] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CA8] [lt=58] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:00.462864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CA9] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:00.538112] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:00.538145] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:00.538163] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:00.589253] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB99] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:00.589292] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB99] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:00.589304] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB99] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:00.589321] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB99] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:07:00.595773] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:00.595779] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:00.595825] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276420174121, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-826, last_round_trip_time:803, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:00.595868] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:00.595825] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276419475632, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:00.595935] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=105] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:00.702517] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943DA] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:01.290353] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E013] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:01.321103] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E013] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:01.321139] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E013] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:01.321149] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E013] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:01.321173] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E013] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:01.321210] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFFE] [lt=78] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:01.321274] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E013] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:01.321291] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E013] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:01.352308] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFFE] [lt=31] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:01.352346] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFFE] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:01.352356] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFFE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:01.352380] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFFE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:01.352438] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E022] [lt=61] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:01.352501] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFFE] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:01.352514] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFFE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:01.389175] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E022] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:01.389193] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E022] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:01.389202] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E022] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:01.389227] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E022] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:01.389311] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E022] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:01.389324] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E022] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:01.389347] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:01.389364] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:01.389433] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=26] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:01.390180] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:01.390373] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:01.391246] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:01.391258] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:01.391479] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=27] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:01.392412] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:01.392418] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:01.392602] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:01.392624] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:01.392632] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:01.392709] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:01.392730] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:07:01.394060] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:01.394118] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:01.394129] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:01.396319] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:01.397752] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:01.476808] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F5] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:01.476869] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F5] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:01.476885] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F5] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:01.476910] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F5] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:07:01.540997] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:01.541020] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:01.541038] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:01.598524] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:01.598575] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276421476776, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-832, last_round_trip_time:803, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:01.598604] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:01.599639] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:01.599684] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276420174121, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-826, last_round_trip_time:803, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:01.599712] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:01.612751] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:01.612796] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=31] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:01.787293] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D8F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:01.802124] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=8] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:01.802142] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=15] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:01.802151] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=148) [2024-01-03 18:07:01.802157] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:01.802163] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:01.802169] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=611983782) [2024-01-03 18:07:01.802192] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:01.802198] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E024] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:01.802224] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E025] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:02.162501] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=27] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:02.162549] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=27] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:02.162565] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:02.163512] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF0-00060E079A34E103] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.164065] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E104] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.164527] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E105] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.165049] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E106] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.175262] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994485] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:02.175310] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994485] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:02.175323] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994485] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:02.175343] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994485] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:07:02.321463] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFDF] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:02.353541] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFDF] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:02.353570] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFDF] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:02.353579] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFDF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:02.353603] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFDF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:02.353665] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E001] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:02.353712] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFDF] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:02.353726] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFDF] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:02.383296] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E001] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:02.383332] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E001] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:02.383342] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E001] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:02.383366] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E001] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:02.383477] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E001] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:02.383490] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E001] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:02.389471] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E016] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:02.418025] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E016] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:02.418067] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E016] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:02.418077] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E016] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:02.418102] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E016] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:02.418220] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E016] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:02.418235] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E016] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:02.463836] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CAB] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.464546] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CAC] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:07:02.465337] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CAD] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.466127] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CAE] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:02.466743] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CAF] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.467295] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CB0] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:02.467924] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CB1] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:02.543419] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:02.543450] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:02.543459] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:02.590070] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9A] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:02.590104] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9A] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:02.590115] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:02.590133] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:07:02.601211] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:02.601287] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276421476776, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-832, last_round_trip_time:803, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:02.601332] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:02.601905] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:02.601969] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276422175224, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-822, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:02.601997] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:03.353902] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E017] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:03.384507] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E017] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:03.384568] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E017] [lt=57] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:03.384581] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E017] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:03.384613] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E017] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:03.384691] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E028] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:03.384738] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E017] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:03.384760] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E017] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:03.413404] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E028] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:03.413440] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E028] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:03.413449] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E028] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:03.413473] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E028] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:03.413577] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E028] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:03.413590] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E028] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:03.418339] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFE2] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:03.455198] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFE2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:03.455248] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFE2] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:03.455262] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFE2] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:03.455300] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFE2] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:03.455415] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFE2] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:03.455438] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFE2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:03.478031] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:03.478072] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F6] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:03.478084] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:03.478101] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:07:03.546150] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:03.546227] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=71] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:03.546237] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:03.603695] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:03.603748] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276423478000, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-838, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:03.603761] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:03.604325] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:03.604368] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276422175224, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-822, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:03.604393] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:03.788159] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D90] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:03.788833] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D91] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:07:03.789620] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D92] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:03.790104] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D93] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:03.790591] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D94] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:03.791056] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D95] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:03.791665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D96] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.165895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E107] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.166512] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E108] [lt=85] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.167053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E109] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.167724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E10A] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.176323] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994486] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:04.176370] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994486] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:04.176382] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994486] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:04.176399] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994486] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=147, ddl_arg=NULL) [2024-01-03 18:07:04.337944] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428455] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:04.384977] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFE3] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:04.413925] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFE3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:04.413941] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFE3] [lt=14] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:04.413989] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFE3] [lt=46] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:04.414013] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFE3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:04.414116] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFE3] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:04.414128] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFE3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:04.414073] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E006] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:04.446413] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E006] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:04.446458] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E006] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:04.446472] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E006] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:04.446504] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E006] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:04.446647] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E006] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:04.446668] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E006] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:04.455614] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E01A] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:04.468986] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CB2] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.469937] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CB3] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:04.470696] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CB4] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.471260] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CB5] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:04.471732] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CB6] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.472213] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CB7] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:04.472699] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CB8] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:04.487028] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E01A] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:04.487066] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E01A] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:04.487077] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E01A] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:04.487100] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E01A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:04.487205] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E01A] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:04.487226] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E01A] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:04.548849] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:04.548878] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:04.548888] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:04.590929] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9B] [lt=48] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:04.590995] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9B] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:04.591007] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9B] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:04.591024] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:07:04.606566] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=46] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:04.606720] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=84] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276423478000, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-838, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:04.606742] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:04.607082] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=42] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:04.607124] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276424176257, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-812, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:04.607137] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:04.978205] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB01] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:05.414293] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E01B] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:05.446053] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E01B] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:05.446071] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E01B] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:05.446081] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E01B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:05.446105] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E01B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:05.446209] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E01B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:05.446222] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E01B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:05.446831] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E02D] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:05.476831] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E02D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:05.476866] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E02D] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:05.476875] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E02D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:05.476898] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E02D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:05.477033] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E02D] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:05.477050] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E02D] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:05.479143] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F7] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:05.479163] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F7] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:05.479173] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F7] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:05.479188] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F7] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=77, ddl_arg=NULL) [2024-01-03 18:07:05.487413] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFE6] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:05.517795] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFE6] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:05.517830] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFE6] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:05.517840] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFE6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:05.517864] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFE6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:05.517981] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFE6] [lt=41] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:05.517995] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFE6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:05.518017] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:05.518035] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:05.518110] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:05.518807] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=17] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:05.518996] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:05.519901] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:05.519909] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:05.520130] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=41] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:05.521195] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:05.521201] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:05.521378] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:05.521401] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:05.521410] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:05.521482] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=15] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:05.521497] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:07:05.522903] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=4] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:05.522999] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=76] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:05.523038] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=35] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:05.525684] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:05.527251] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:05.551675] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=57] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:05.551780] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=90] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:05.551817] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:05.609627] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=55] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:05.609689] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276424176257, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-812, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:05.609718] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:05.610205] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:05.610252] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276425479114, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-790, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:05.610287] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:05.734224] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:05.734235] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:05.898926] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:05.898938] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=9] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:05.898962] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=149) [2024-01-03 18:07:05.898969] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:05.898976] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:05.898982] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=616080594) [2024-01-03 18:07:05.899004] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:05.899011] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14DFE8] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:05.899034] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14DFE9] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:05.899145] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14DFE9] [lt=12] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:05.920077] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D98] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:05.920675] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D99] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:07:05.921252] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D9A] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:05.921844] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D9B] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:05.922371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D9C] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:05.922932] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D9D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:05.923481] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D9E] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.168493] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E10B] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.169007] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E10C] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.169433] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E10D] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.169863] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E10E] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.177577] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994487] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:06.177613] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994487] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:06.177623] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994487] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:06.177640] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994487] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=93, ddl_arg=NULL) [2024-01-03 18:07:06.446369] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E00B] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:06.475074] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E00B] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:06.475109] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E00B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:06.475118] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E00B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:06.475141] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E00B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:06.475239] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E00B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:06.475252] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E00B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:06.477198] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E030] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:06.509655] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E030] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:06.509697] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E030] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:06.509707] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E030] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:06.509729] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E030] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:06.509835] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E030] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:06.509848] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E030] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:06.518149] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E01E] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:06.549181] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E01E] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:06.549199] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E01E] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:06.549208] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E01E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:06.549233] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E01E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:06.549314] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E01E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:06.549367] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E01E] [lt=43] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:06.554150] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:06.554179] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:06.554188] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:06.591839] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9C] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:06.591875] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9C] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:06.591896] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9C] [lt=18] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:06.591934] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:07:06.601984] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CBA] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.602592] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CBB] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:06.603151] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CBC] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.603602] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CBD] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:06.604071] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CBE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.604559] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CBF] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:07:06.605054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC0] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:06.612009] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:06.612080] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276426177549, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-761, last_round_trip_time:835, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:06.612093] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:06.612571] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=54] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:06.612634] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276425479114, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-790, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:06.612661] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:07.164613] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:07.164663] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=20] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:07.164718] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=36] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:07.475438] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E01F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:07.480345] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F8] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:07.480375] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F8] [lt=26] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:07.480394] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F8] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:07.480418] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F8] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:07:07.504707] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E01F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:07.504744] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E01F] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:07.504754] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E01F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:07.504776] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E01F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:07.504872] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E01F] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:07.504897] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E01F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:07.510011] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFEC] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:07.538394] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFEC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:07.538430] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFEC] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:07.538440] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFEC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:07.538463] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFEC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:07.538559] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFEC] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:07.538571] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFEC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:07.549571] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E00E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:07.557246] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:07.557275] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:07.557285] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:07.580623] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E00E] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:07.580659] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E00E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:07.580668] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E00E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:07.580692] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E00E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:07.580786] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E00E] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:07.580799] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E00E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:07.614841] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:07.614891] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276427480304, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-798, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:07.614938] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=51] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:07.614975] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=78] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:07.615024] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276426177549, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-761, last_round_trip_time:835, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:07.615066] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:07.924334] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D9F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:07.925078] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DA0] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:07.925710] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DA1] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:07.926247] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DA2] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:07.926809] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DA3] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:07.927306] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DA4] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:07.927826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DA5] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.170681] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E110] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.171189] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E111] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.171624] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E112] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.172182] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E113] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.178521] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994488] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:08.178560] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994488] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:08.178571] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994488] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:08.178587] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994488] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:07:08.505011] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E035] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:08.538156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E035] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:08.538193] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E035] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:08.538203] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E035] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:08.538227] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E035] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:08.538329] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E035] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:08.538357] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E035] [lt=22] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:08.538679] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E00F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:08.560035] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=57] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:08.560049] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:08.560060] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:08.570871] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E00F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:08.570889] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E00F] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:08.570899] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E00F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:08.570923] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E00F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:08.571052] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E00F] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:08.571070] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E00F] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:08.580976] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E022] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:08.592720] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9D] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:08.592757] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9D] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:08.592771] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9D] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:08.592789] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9D] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:07:08.606002] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC1] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.606861] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CC2] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:07:08.607571] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC3] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.608234] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CC4] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:08.608892] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.609423] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CC6] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:08.609991] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:08.612914] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E022] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:08.612987] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E022] [lt=69] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:08.612998] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E022] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:08.613024] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E022] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:08.613130] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E022] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:08.613154] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E022] [lt=16] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:08.617863] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:08.617914] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276427480304, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-798, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:08.617927] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:08.618804] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:08.618869] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276428178490, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-815, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:08.618907] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:09.338808] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428456] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:09.481709] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284F9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:09.481739] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284F9] [lt=27] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:09.481750] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284F9] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:09.481767] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284F9] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:07:09.538493] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E010] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:09.562502] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:09.562530] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:09.562540] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:09.569256] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E010] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:09.569273] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E010] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:09.569283] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E010] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:09.569308] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E010] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:09.569433] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E010] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:09.569446] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E010] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:09.571275] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E038] [lt=42] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:09.601762] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E038] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:09.601802] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E038] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:09.601813] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E038] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:09.601837] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E038] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:09.601939] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E038] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:09.602013] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E038] [lt=63] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:09.602059] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=9] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:09.602077] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:09.602175] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=24] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:09.602907] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:09.603126] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:09.604080] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=41] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:09.604101] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=20] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:09.604281] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:09.605246] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=59] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:09.605259] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:09.605494] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:09.605517] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:09.605526] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:09.605653] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:09.605661] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] broadcast root address succeed [2024-01-03 18:07:09.607247] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:09.607307] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:09.607333] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=23] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:09.609616] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:09.611218] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=48] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:09.613375] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFF3] [lt=61] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:09.620333] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:09.620405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276429481674, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-897, last_round_trip_time:864, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:09.620432] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:09.622009] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=77] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:09.622066] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276428178490, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-815, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:09.622097] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:09.647122] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFF3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:09.647160] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFF3] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:09.647175] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFF3] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:09.647209] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFF3] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:09.647355] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFF3] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:09.647369] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFF3] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:09.865326] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:09.865339] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=8] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:09.928733] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DA6] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:09.929616] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DA7] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:07:09.930304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DA8] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:09.930852] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DA9] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:09.931456] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DAA] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:09.931930] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DAB] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:09.932408] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DAC] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:09.978780] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB02] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:10.074084] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:10.074094] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:10.074106] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=150) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:07:10.074130] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=23] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:10.074139] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=7] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:10.074147] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=620255759) [2024-01-03 18:07:10.074177] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:10.074198] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E03A] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:10.074226] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E03B] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:07:10.074378] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E03B] [lt=19] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:10.173126] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E114] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.173643] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E115] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.174085] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E116] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.174616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E117] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.179610] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994489] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:10.179650] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994489] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:10.179662] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994489] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:10.179679] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994489] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:07:10.565313] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:10.565348] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:10.565358] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:10.569584] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E013] [lt=43] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:10.593590] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:10.593630] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9E] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:10.593641] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:10.593659] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9E] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:07:10.602370] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E013] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:10.602409] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E013] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:10.602420] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E013] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:10.602448] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E013] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:10.602532] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFF4] [lt=106] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:10.602566] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E013] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:10.602589] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E013] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:10.610909] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CC8] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.612003] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CC9] [lt=79] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:07:10.612681] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2003][454][YB42C0A86EF2-00060E079EC94CCA] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.613336] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CCB] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:10.613893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CCC] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.614456] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CCD] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:10.615034] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CCE] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:10.623102] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:10.623153] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276429481674, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-897, last_round_trip_time:864, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:10.623180] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:10.624624] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:10.624666] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276430179578, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-890, last_round_trip_time:835, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:10.624692] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:10.633327] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFF4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:10.633363] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFF4] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:10.633372] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFF4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:10.633396] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFF4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:10.633494] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFF4] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:10.633508] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFF4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:10.647606] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E014] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:10.679922] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E014] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:10.679976] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E014] [lt=51] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:10.679987] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E014] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:10.680011] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E014] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:10.680117] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E014] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:10.680132] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E014] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:10.704185] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943DC] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:11.482627] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:11.482674] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FA] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:11.482688] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FA] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:11.482705] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FA] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:07:11.568267] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:11.568311] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:11.568327] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:11.602780] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E02B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:11.627005] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:11.627111] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276431482581, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-954, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:11.627132] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:11.628420] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:11.628473] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276430179578, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-890, last_round_trip_time:835, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:11.628500] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:11.635871] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E02B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:11.635908] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E02B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:11.635919] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E02B] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:11.635943] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E02B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:11.636044] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E040] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:11.636143] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E02B] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:11.636158] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E02B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:11.668452] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E040] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:11.668492] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E040] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:11.668502] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E040] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:11.668526] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E040] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:11.668650] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E040] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:11.668667] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E040] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:11.680282] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFF7] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:11.709064] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFF7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:11.709099] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFF7] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:11.709109] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFF7] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:11.709133] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFF7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:11.709232] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFF7] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:11.709245] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFF7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:11.933314] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DAE] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:11.934152] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DAF] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:07:11.934754] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DB0] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:11.935562] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DB1] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=51, ddl_arg=NULL) [2024-01-03 18:07:11.936127] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DB2] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:11.936718] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DB3] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:11.937154] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF1-00060E079C528DB4] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.180631] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448A] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:12.180692] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448A] [lt=58] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:12.180703] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448A] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:12.180719] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:07:12.321003] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=29] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:12.321068] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:12.321103] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=23] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:12.322279] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E119] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.322768] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11A] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.323187] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11B] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.323786] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11C] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.570704] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:12.570733] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:12.570742] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:12.594371] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB9F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:12.594406] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB9F] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:12.594415] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB9F] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:12.594431] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB9F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=89, ddl_arg=NULL) [2024-01-03 18:07:12.615933] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CD0] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.616775] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CD1] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:12.617484] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CD2] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.618040] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CD3] [lt=72] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:12.618582] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CD4] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.619079] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CD5] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:12.619513] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CD6] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:12.629661] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:12.629712] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276431482581, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-954, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:12.629725] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:12.631055] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:12.631098] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276432180603, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-847, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:12.631124] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:12.636309] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFF8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:12.669907] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFF8] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:12.669929] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFF8] [lt=19] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:12.669942] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFF8] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:12.670004] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFF8] [lt=39] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:12.670074] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E019] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:12.670146] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFF8] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:12.670186] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFF8] [lt=30] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:12.704018] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E019] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:12.704055] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E019] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:12.704065] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E019] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:12.704089] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E019] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:12.704190] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E019] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:12.704207] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E019] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:12.709381] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E02E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:12.739780] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E02E] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:12.739829] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E02E] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:12.739846] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E02E] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:12.739876] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E02E] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:12.740009] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E02E] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:12.740027] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E02E] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:13.483651] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FB] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:13.483722] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FB] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:13.483744] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FB] [lt=16] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:13.483772] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FB] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=169, ddl_arg=NULL) [2024-01-03 18:07:13.573378] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:13.573416] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:13.573425] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:13.632296] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:13.632346] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276433483606, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-849, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:13.632372] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:13.633736] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:13.633776] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276432180603, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-847, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:13.633787] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:13.633806] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:13.633819] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:13.633867] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=16] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:13.634609] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=25] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:13.634789] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:13.635681] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=25] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:13.635689] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:13.635895] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:13.637035] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:13.637045] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:13.637237] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:13.637259] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:13.637267] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:07:13.637363] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:13.637372] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=8] [dc=0] broadcast root address succeed [2024-01-03 18:07:13.638712] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:13.638764] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=35] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:13.638774] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:13.640943] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:13.642473] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=34] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:13.670354] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E02F] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:13.702799] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E02F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:13.702829] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E02F] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:13.702864] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E02F] [lt=31] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:13.702897] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E02F] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:13.703026] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E02F] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:13.703045] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E02F] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:13.704348] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E045] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:13.733994] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E045] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:13.734039] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E045] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:13.734053] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E045] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:13.734076] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E045] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:13.734230] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E045] [lt=77] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:13.734245] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E045] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:13.740176] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFFB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:13.776357] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFFB] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:13.776393] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFFB] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:13.776403] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFFB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:13.776426] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFFB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:13.776523] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFFB] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:13.776536] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFFB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:13.879914] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:13.879928] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:13.938078] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DB5] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:13.938913] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DB6] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:13.939593] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DB7] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:13.940362] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DB8] [lt=64] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:13.941018] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DB9] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:13.941632] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DBA] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:13.942199] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DBB] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.079628] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:14.079638] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:14.079649] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=151) [2024-01-03 18:07:14.079657] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:14.079664] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:14.079672] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=624261285) [2024-01-03 18:07:14.079698] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:14.079719] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E01D] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:14.079746] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E01E] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:14.079891] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E01E] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:14.181772] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448B] [lt=45] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:14.181812] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448B] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:14.181823] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448B] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:14.181840] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:07:14.324719] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.325259] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11E] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.325725] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E11F] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.326175] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E120] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.339659] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428457] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:07:14.575818] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:14.575852] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:14.575866] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:14.595075] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:14.595109] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA0] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:14.595123] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA0] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:14.595138] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA0] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:07:14.620411] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CD7] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.621257] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CD8] [lt=75] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:14.621993] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2007][462][YB42C0A86EF2-00060E079EC94CD9] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.622532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CDA] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:14.623062] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CDB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.623532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CDC] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:14.624016] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CDD] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:14.634698] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:14.634747] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276433483606, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-849, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:14.634759] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:14.636088] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:14.636135] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276434181742, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:834, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:14.636160] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:14.703210] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E01F] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:14.734132] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E01F] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:14.734170] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E01F] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:14.734180] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E01F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:14.734203] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E01F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:14.734331] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E01F] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:14.734348] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E01F] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:14.734407] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E032] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:14.767476] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E032] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:14.767515] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E032] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:14.767525] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E032] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:14.767549] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E032] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:14.767651] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E032] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:14.767663] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E032] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:14.776672] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E048] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:14.804699] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E048] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:14.804733] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E048] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:14.804743] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E048] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:14.804767] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E048] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:14.804860] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E048] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:14.804872] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E048] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:14.979490] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB03] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:15.484923] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:15.484966] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FC] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:15.484976] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FC] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:15.484997] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FC] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:07:15.578534] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:15.578565] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:15.578578] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:15.637307] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:15.637383] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276435484895, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-875, last_round_trip_time:881, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:15.637449] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=61] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:15.639193] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:15.639261] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276434181742, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:834, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:15.639281] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:15.705015] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943DD] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:07:15.734489] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E049] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:15.772710] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E049] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:15.772748] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E049] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:15.772761] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E049] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:15.772796] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E049] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:15.772858] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E000] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:15.772971] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E049] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:15.772991] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E049] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:15.800279] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E000] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:15.800295] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E000] [lt=14] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:15.800304] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E000] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:15.800327] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E000] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:15.800427] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E000] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:15.800439] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E000] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:15.805008] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E022] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:15.833369] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E022] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:15.833391] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E022] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:15.833400] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E022] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:15.833423] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E022] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:15.833567] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E022] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:15.833584] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E022] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:16.084292] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DBD] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.085023] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DBE] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:16.085727] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DBF] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.086446] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DC0] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:16.087030] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DC1] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.087579] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DC2] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:16.088165] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DC3] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.182888] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448C] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:16.182962] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448C] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:16.182976] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448C] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:16.182992] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448C] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=137, ddl_arg=NULL) [2024-01-03 18:07:16.327069] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E121] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.327597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E122] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.327973] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E123] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.328370] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E124] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.580870] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:16.580891] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:16.580901] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:16.595990] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA1] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:16.596043] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA1] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:16.596054] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:16.596072] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=137, ddl_arg=NULL) [2024-01-03 18:07:16.640488] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:16.640551] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276435484895, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-875, last_round_trip_time:881, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:16.640586] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:16.641824] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:16.641902] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276436182858, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:16.641967] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=58] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:16.760078] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CDF] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.760875] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CE0] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:07:16.761519] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CE1] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.761987] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CE2] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:16.762474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CE3] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.763006] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CE4] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:16.763865] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CE5] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:16.773187] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E023] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:16.806821] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E023] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:16.806873] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E023] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:16.806893] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E023] [lt=17] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:16.806918] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E023] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:16.806980] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E037] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:16.807097] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E023] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:16.807120] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E023] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:16.836418] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E037] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:16.836457] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E037] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:16.836468] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E037] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:16.836492] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E037] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:16.836581] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E04C] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:16.836676] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E037] [lt=84] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:16.836691] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E037] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:16.866936] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E04C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:16.867000] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E04C] [lt=62] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:16.867011] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E04C] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:16.867036] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E04C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:16.867138] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E04C] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:16.867151] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E04C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:17.322526] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:17.322586] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:17.322604] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:17.486105] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FD] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:17.486171] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FD] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:17.486184] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FD] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:17.486202] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FD] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:07:17.583522] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:17.583570] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=40] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:17.583585] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:17.643331] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:17.643383] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276437486073, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-880, last_round_trip_time:899, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:17.643409] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:17.644769] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=59] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:17.644814] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276436182858, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:17.644826] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:17.644862] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:17.644880] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:17.644983] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=25] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:17.645928] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:17.646295] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=28] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:17.647548] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=14] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:17.647558] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:17.647982] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=50] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:17.649073] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=66] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:17.649081] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:17.649272] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:17.649282] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:17.649290] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:17.649372] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:17.649387] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:07:17.650727] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:17.650784] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:17.650795] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:17.653271] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:17.654987] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=50] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:17.807274] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E04D] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:17.838770] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E04D] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:17.838812] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E04D] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:17.838828] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E04D] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:17.838862] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E04D] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:17.838929] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E005] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:17.839036] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E04D] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:17.839048] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E04D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:17.871447] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E005] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:17.871482] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E005] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:17.871491] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E005] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:17.871515] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E005] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:17.871581] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E026] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:17.871622] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E005] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:17.871635] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E005] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:17.903015] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E026] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:17.903053] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E026] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:17.903063] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E026] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:17.903087] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E026] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:17.903187] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E026] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:17.903201] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E026] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:17.908554] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:17.908565] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:18.090615] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DC6] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.092809] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DCA] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.142028] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:18.142042] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=9] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:18.142060] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=10] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=152) [2024-01-03 18:07:18.142073] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:18.142086] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=10] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:18.142097] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=8] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=628323709) [2024-01-03 18:07:18.142143] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=9] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:18.142167] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E03B] [lt=21] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:18.142206] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E03C] [lt=10] [dc=0] start to process rs list update task [2024-01-03 18:07:18.142507] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E03C] [lt=116] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:18.183998] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448D] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:18.184024] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448D] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:18.184040] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448D] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:18.184057] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448D] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=122, ddl_arg=NULL) [2024-01-03 18:07:18.329279] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E126] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.329912] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E127] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.330426] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E128] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.330971] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E129] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.586246] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:18.586275] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:18.586285] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:18.596987] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA2] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:18.597031] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA2] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:18.597050] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA2] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:18.597078] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA2] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=158, ddl_arg=NULL) [2024-01-03 18:07:18.647106] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:18.647223] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276437486073, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-880, last_round_trip_time:899, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:18.647243] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:18.647767] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:18.647824] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276438183939, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-862, last_round_trip_time:834, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:18.647843] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:18.764932] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94CE6] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.765754] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CE7] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:07:18.766348] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CE8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.766967] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CE9] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:18.767508] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CEA] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.768136] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CEB] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:18.768707] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CEC] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:18.839207] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E03D] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:18.870110] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E03D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:18.870162] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E03D] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:18.870177] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E03D] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:18.870205] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E03D] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:18.870348] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E03D] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:18.870369] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E03D] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:18.871780] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E050] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:18.902207] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E050] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:18.902243] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E050] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:18.902253] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E050] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:18.902277] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E050] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:18.902381] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E050] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:18.902395] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E050] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:18.903352] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E008] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:18.935302] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E008] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:18.935358] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E008] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:18.935373] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E008] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:18.935408] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E008] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:18.935569] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E008] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:18.935591] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E008] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:19.340386] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428458] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:19.487107] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FE] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:19.487164] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FE] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:19.487176] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FE] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:19.487193] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FE] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:07:19.588685] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:19.588714] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:19.588724] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:19.649974] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=49] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:19.650027] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276439487075, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-918, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:19.650039] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:19.651793] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:19.651861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276438183939, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-862, last_round_trip_time:834, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:19.651908] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:19.870552] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E009] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:19.901840] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E009] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:19.901883] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E009] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:19.901893] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E009] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:19.901918] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E009] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:19.902095] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E009] [lt=77] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:19.902111] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E009] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:19.902554] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E02B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:19.933203] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E02B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:19.933238] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E02B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:19.933248] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E02B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:19.933271] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E02B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:19.933370] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E02B] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:19.933383] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E02B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:19.935753] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E040] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:19.965839] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E040] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:19.965875] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E040] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:19.965885] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E040] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:19.965908] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E040] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:19.966055] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E040] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:19.966068] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E040] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:19.980165] INFO [RS] ob_rs_rpc_processor.h:196 [2012][472][YB42C0A86EF0-00060E079A24DB04] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:20.093658] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DCB] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.094449] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DCC] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:07:20.095263] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DCD] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.095854] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DCE] [lt=81] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:20.096538] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DCF] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.097122] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DD0] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:20.097648] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DD1] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.185123] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448E] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:20.185164] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448E] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:20.185176] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:20.185193] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448E] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:07:20.331738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E12A] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.332251] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E12B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.332696] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E12C] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.333100] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E12D] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.592197] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:20.592235] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:20.592251] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:20.597931] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:20.598035] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA3] [lt=99] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:20.598050] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA3] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:20.598073] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA3] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=181, ddl_arg=NULL) [2024-01-03 18:07:20.652629] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:20.652676] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276439487075, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-918, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:20.652706] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:20.654683] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:20.654724] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276440185091, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-927, last_round_trip_time:839, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:20.654741] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:20.705835] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943DE] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:20.769665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CED] [lt=67] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.770282] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CEE] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:20.770842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CEF] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.771333] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CF0] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:20.771798] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CF1] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.772304] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CF2] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:07:20.772796] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CF3] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:20.902255] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E041] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:20.931495] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E041] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:20.931530] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E041] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:20.931539] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E041] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:20.931562] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E041] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:20.931645] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E041] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:20.931656] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E041] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:20.933496] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E055] [lt=27] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:20.967735] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E055] [lt=39] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:20.967779] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E055] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:20.967793] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E055] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:20.967827] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E055] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:20.967902] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E00C] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:20.967985] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E055] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:20.968028] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E055] [lt=36] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:21.000051] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E00C] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:21.000089] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E00C] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:21.000099] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E00C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:21.000123] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E00C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:21.000241] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E00C] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:21.000254] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E00C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:21.488224] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284FF] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:21.488267] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284FF] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:21.488278] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284FF] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:21.488293] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284FF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=151, ddl_arg=NULL) [2024-01-03 18:07:21.595192] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:21.595221] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:21.595231] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:21.655218] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:21.655293] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276441488145, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-865, last_round_trip_time:898, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:21.655315] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:21.657351] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:21.657408] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276440185091, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-927, last_round_trip_time:839, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:21.657439] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:21.657464] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:21.657486] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:21.657584] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=23] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:21.658310] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:21.658507] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:21.659388] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=15] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:21.659395] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:21.659568] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:21.660549] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=27] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:21.660564] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:21.660850] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=29] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:21.660907] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=52] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:21.660920] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=10] [dc=0] start to process rs list update task [2024-01-03 18:07:21.661063] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=32] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:21.661080] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=15] [dc=0] broadcast root address succeed [2024-01-03 18:07:21.662578] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=11] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:21.662640] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=45] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:21.662679] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=36] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:21.665794] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=14] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:21.667849] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=49] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:21.906894] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:21.906904] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:21.931751] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E00D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:21.962685] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E00D] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:21.962710] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E00D] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:21.962720] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E00D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:21.962743] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E00D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:21.962900] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E00D] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:21.962919] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E00D] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:21.968192] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E030] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:21.999368] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E030] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:21.999404] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E030] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:21.999414] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E030] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:21.999436] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E030] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:21.999528] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E030] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:21.999541] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E030] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:22.000386] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E044] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:22.026669] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E044] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:22.026702] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E044] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:22.026712] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E044] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:22.026734] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E044] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:22.026854] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E044] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:22.026866] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E044] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:22.099982] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DD5] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.102359] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DD9] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.129693] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:22.129704] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:22.129715] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=153) [2024-01-03 18:07:22.129724] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:22.129731] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:22.129739] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=632311351) [2024-01-03 18:07:22.129765] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:22.129788] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E059] [lt=20] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:22.129815] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E05A] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:22.129966] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E05A] [lt=20] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:22.186194] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99448F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:22.186232] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99448F] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:22.186243] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99448F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:22.186259] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99448F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:07:22.503240] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=70] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:22.503304] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:22.503332] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=17] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:22.504255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E12F] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.504685] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E130] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.505178] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E131] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.505596] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E132] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.597759] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:22.597814] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:22.597824] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:22.598869] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:22.598909] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA4] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:22.598921] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:22.598937] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA4] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=121, ddl_arg=NULL) [2024-01-03 18:07:22.658000] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:22.658067] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276441488145, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-865, last_round_trip_time:898, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:22.658102] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:22.659769] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:22.659833] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276442186136, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:22.659871] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:22.773736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CF5] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.774540] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CF6] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:22.775076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CF7] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.775633] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CF8] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:22.776135] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CF9] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.776613] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CFA] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:22.777062] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CFB] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:22.963096] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E05B] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:22.993082] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E05B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:22.993121] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E05B] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:22.993131] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E05B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:22.993163] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E05B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:22.993309] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E05B] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:22.993322] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E05B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:22.999691] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E010] [lt=29] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:23.027790] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E010] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:23.027824] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E010] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:23.027834] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E010] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:23.027856] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E010] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:23.027915] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E033] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:23.028001] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E010] [lt=64] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:23.028032] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E010] [lt=24] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:23.057928] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E033] [lt=52] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:23.057985] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E033] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:23.058001] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E033] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:23.058033] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E033] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:23.058138] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E033] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:23.058150] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E033] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:23.489410] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428500] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:23.489457] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428500] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:23.489475] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428500] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:23.489496] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428500] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:07:23.600598] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:23.600628] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:23.600641] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:23.661187] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:23.661246] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276443489373, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-935, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:23.661285] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:23.662575] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:23.662640] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276442186136, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:23.662668] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:23.993480] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E034] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:24.024781] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E034] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:24.024818] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E034] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:24.024828] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E034] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:24.024851] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E034] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:24.024941] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E034] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:24.024986] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E034] [lt=34] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:24.028181] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E049] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:24.057782] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E049] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:24.057800] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E049] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:24.057812] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E049] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:24.057835] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E049] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:24.057927] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E049] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:24.057939] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E049] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:24.058303] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E05E] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:24.087765] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E05E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:24.087800] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E05E] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:24.087810] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E05E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:24.087833] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E05E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:24.087932] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E05E] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:24.087982] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E05E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:24.103268] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DDA] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.103925] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DDB] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:24.104554] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DDC] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.105099] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DDD] [lt=83] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:24.105587] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DDE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.106193] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DDF] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:24.106860] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.187386] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994490] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:24.187423] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994490] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:24.187434] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994490] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:24.187450] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994490] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:07:24.341187] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428459] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:24.506478] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E133] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.506941] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E134] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.507412] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E135] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.507781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E136] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.599606] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA5] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:24.599644] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA5] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:24.599656] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA5] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:24.599671] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA5] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:07:24.603244] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:24.603266] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:24.603276] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:24.664211] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:24.664264] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276443489373, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-935, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:24.664278] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:24.665384] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:24.665429] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276444187325, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-906, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:24.665460] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:24.777848] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CFC] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.778558] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CFD] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:24.779191] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94CFE] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.779787] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94CFF] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:24.780234] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D00] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.780778] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D01] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:24.781291] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D02] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:24.980823] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB05] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:25.025141] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E05F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:25.054802] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E05F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:25.054837] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E05F] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:25.054846] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E05F] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:25.054874] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E05F] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:25.054977] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E05F] [lt=40] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:25.054990] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E05F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:25.058112] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E015] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:25.084699] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E015] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:25.084738] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E015] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:25.084753] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E015] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:25.084775] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E015] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:25.084861] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E015] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:25.084873] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E015] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:25.088149] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E037] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:25.116870] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E037] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:25.116908] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E037] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:25.116918] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E037] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:25.116972] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E037] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:25.117104] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E037] [lt=40] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:25.117117] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E037] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:25.490522] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428501] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:25.490551] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428501] [lt=26] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:25.490561] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428501] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:25.490602] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428501] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:07:25.605774] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:25.605816] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:25.605830] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:25.667342] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:25.667390] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276445490491, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:899, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:25.667402] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:25.668087] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:25.668137] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276444187325, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-906, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:25.668177] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:25.668205] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=9] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:25.668225] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=11] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:25.668321] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=26] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:25.669077] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:25.669294] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=18] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:25.670385] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=36] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:25.670398] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:25.670800] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=33] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:25.672144] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=71] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:25.672187] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=39] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:25.672562] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:25.672580] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=14] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:25.672592] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:07:25.672683] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=28] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:25.672691] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:07:25.674131] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=50] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:25.674192] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:25.674204] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:25.676636] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:25.678284] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:25.706765] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943DF] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:25.905290] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:25.905301] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:26.123128] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E04E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:26.123168] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E04E] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:26.123178] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E04E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:26.123201] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E04E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:26.123257] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E062] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:26.123335] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E04E] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:26.123355] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E04E] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:26.132420] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:26.132434] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:26.132446] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=154) [2024-01-03 18:07:26.132455] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:26.132463] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:26.132471] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=636314083) [2024-01-03 18:07:26.132498] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:26.132518] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E019] [lt=18] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:26.157983] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E062] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:26.158017] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E062] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:26.158027] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E062] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:26.158050] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E062] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:26.158172] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E062] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:26.158185] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E062] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:26.158213] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E063] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:26.158379] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E063] [lt=33] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:26.188340] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994491] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:26.188376] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994491] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:26.188387] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994491] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:26.188404] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994491] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:07:26.246164] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE2] [lt=67] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.246770] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DE3] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:26.247388] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE4] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.248075] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DE5] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:26.248591] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE6] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.249139] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DE7] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:26.249676] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.508697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E137] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.509299] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E138] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.509738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E139] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.510223] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E13A] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.600497] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:26.600536] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA6] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:26.600548] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:26.600564] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:07:26.608597] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:26.608620] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:26.608630] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:26.669987] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:26.670060] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276445490491, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-863, last_round_trip_time:899, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:26.670074] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:26.670520] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:26.670561] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276446188309, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1000, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:26.670593] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:26.909360] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D04] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.910034] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D05] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:07:26.910577] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D06] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.911072] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D07] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:26.911537] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D08] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:26.912018] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D09] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:26.912489] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF2-00060E079EC94D0A] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:27.093524] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E064] [lt=24] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:27.122676] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E064] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:27.122711] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E064] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:27.122721] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E064] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:27.122745] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E064] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:27.122843] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E064] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:27.122856] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E064] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:27.123549] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E03B] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:27.161075] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E03B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:27.161111] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E03B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:27.161121] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E03B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:27.161144] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E03B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:27.161198] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E051] [lt=57] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:27.161243] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E03B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:27.161255] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E03B] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:27.189825] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E051] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:27.189860] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E051] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:27.189869] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E051] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:27.189893] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E051] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:27.190000] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E051] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:27.190011] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E051] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:27.491568] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428502] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:27.491609] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428502] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:27.491620] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428502] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:27.491636] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428502] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:07:27.504723] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=63] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:27.504823] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=73] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:27.504865] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=23] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:27.611048] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:27.611092] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:27.611102] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:27.672553] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=42] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:27.672630] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276447491537, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-867, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:27.672643] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:27.672740] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:27.672783] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276446188309, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1000, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:27.672812] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:28.123026] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E052] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:28.155990] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E052] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:28.156032] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E052] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:28.156042] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E052] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:28.156066] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E052] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:28.156168] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E052] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:28.156185] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E052] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:28.161411] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E01E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:28.189342] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994492] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:28.189381] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994492] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:28.189393] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994492] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:28.189416] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994492] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:07:28.191302] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E01E] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:28.191339] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E01E] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:28.191348] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E01E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:28.191371] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E01E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:28.191424] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E067] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:28.191467] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E01E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:28.191479] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E01E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:28.218973] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E067] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:28.219007] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E067] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:28.219017] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E067] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:28.219048] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E067] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:28.219182] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E067] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:28.219195] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E067] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:28.250596] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DE9] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.251266] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DEA] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:28.251993] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DEB] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.252575] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DEC] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:28.253174] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DED] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.253703] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DEE] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:28.254233] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DEF] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.511229] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E13C] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.511723] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E13D] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.512187] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E13E] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.512613] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E13F] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.601367] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA7] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:28.601405] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA7] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:28.601421] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA7] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:28.601444] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA7] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:07:28.613648] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:28.613689] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:28.613699] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:28.675129] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:28.675178] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276448189312, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-924, last_round_trip_time:826, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:28.675190] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:28.675261] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:28.675304] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276447491537, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-867, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:28.675335] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:28.913316] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D0B] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.913987] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D0C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:28.914587] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D0D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.915116] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D0E] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:28.915570] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D0F] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:28.915999] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D10] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:28.916524] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D11] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:29.156346] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E068] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:29.186469] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E068] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:29.186508] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E068] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:29.186525] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E068] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:29.186559] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E068] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:29.186681] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E068] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:29.186697] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E068] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:29.191629] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E040] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:29.223142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E040] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:29.223178] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E040] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:29.223188] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E040] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:29.223211] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E040] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:29.223268] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E021] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:29.223312] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E040] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:29.223324] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E040] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:29.251074] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E021] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:29.251110] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E021] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:29.251120] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E021] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:29.251142] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E021] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:29.251253] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E021] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:29.251275] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E021] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:29.251308] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:29.251325] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:29.251386] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:29.252140] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=26] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:29.252457] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=76] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:29.253309] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=33] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:29.253322] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:29.253672] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=38] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:29.254616] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=42] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:29.254656] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=37] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:29.255061] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=75] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:29.255114] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=47] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:29.255130] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=12] [dc=0] start to process rs list update task [2024-01-03 18:07:29.255320] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=30] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:29.255336] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:07:29.259183] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:29.259254] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=47] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:29.259269] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:29.262461] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=15] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:29.264446] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=48] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:29.341854] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42845A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:29.511622] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:29.511632] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:29.616261] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:29.616296] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:29.616305] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:29.708265] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:29.708275] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:29.708286] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=155) [2024-01-03 18:07:29.708294] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:29.708301] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:29.708308] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=639889921) [2024-01-03 18:07:29.708332] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:29.708346] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E023] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:29.708370] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E024] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:29.708498] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E024] [lt=14] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:29.981503] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB06] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:30.026146] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=41] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:07:30.186829] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E057] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:30.190305] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994493] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:30.190354] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994493] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:30.190371] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994493] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:30.190388] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994493] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=114, ddl_arg=NULL) [2024-01-03 18:07:30.215341] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E057] [lt=19] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:30.215373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E057] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:30.215383] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E057] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:30.215405] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E057] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:30.215498] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E057] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:30.215509] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E057] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:30.223455] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E06B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:30.251599] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E06B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:30.251634] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E06B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:30.251644] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E06B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:30.251666] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E06B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:30.251721] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E043] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:30.251759] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E06B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:30.251771] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E06B] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:30.255109] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DF0] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.255729] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DF1] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:07:30.259018] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528DF2] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.259617] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DF3] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:30.260158] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DF4] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.260686] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DF5] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:30.261278] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DF6] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.280738] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E043] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:30.280762] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E043] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:30.280776] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E043] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:30.280804] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E043] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:30.280909] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E043] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:30.280926] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E043] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:30.513399] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E140] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.513789] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E141] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.514241] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF0-00060E079A34E142] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.514630] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E143] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.602143] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:30.602176] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA8] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:30.602187] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA8] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:30.602202] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:07:30.618786] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:30.618807] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:30.618815] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:30.679573] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:30.679645] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276449492502, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-909, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:30.679671] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:30.679682] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:30.679726] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276450190277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-939, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:30.679753] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:30.707727] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E0] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:30.917283] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D12] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.917960] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D13] [lt=90] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:07:30.918532] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D14] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.919066] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D15] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:30.919625] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D16] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:30.920045] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D17] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:30.920513] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D18] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:31.215641] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E044] [lt=29] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:31.241619] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E044] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:31.241651] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E044] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:31.241660] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E044] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:31.241681] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E044] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:31.241764] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E044] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:31.241774] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E044] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:31.251969] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E027] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:31.277229] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E027] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:31.277259] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E027] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:31.277269] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E027] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:31.277290] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E027] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:31.277377] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E027] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:31.277388] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E027] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:31.281087] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E06E] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:31.306384] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E06E] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:31.306423] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E06E] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:31.306433] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E06E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:31.306454] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E06E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:31.306539] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E06E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:31.306550] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E06E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:31.493492] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428504] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:31.493531] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428504] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:31.493543] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428504] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:31.493559] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428504] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:07:31.621238] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:31.621281] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:31.621296] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:31.682130] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:31.682187] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276451493405, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-834, last_round_trip_time:829, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:31.682200] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:31.682391] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:31.682435] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276450190277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-939, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:31.682453] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:32.191465] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994494] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:32.191510] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994494] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:32.191528] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994494] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:32.191549] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994494] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:07:32.241919] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E06F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:32.262299] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DF8] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.263234] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DF9] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:32.264070] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DFA] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.264790] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DFB] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:32.265359] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DFC] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.265892] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528DFD] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:32.266432] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DFE] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.276159] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E06F] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:32.276179] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E06F] [lt=18] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:32.276189] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E06F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:32.276212] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E06F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:32.276344] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E06F] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:32.276358] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E06F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:32.277535] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E05C] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:32.306708] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E05C] [lt=30] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:32.306743] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E05C] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:32.306757] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E05C] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:32.306780] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E05C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:32.306830] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E047] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:32.306885] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E05C] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:32.306897] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E05C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:32.336134] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E047] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:32.336169] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E047] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:32.336179] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E047] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:32.336202] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E047] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:32.336300] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E047] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:32.336313] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E047] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:32.602939] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBA9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:32.602988] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBA9] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:32.602998] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBA9] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:32.603015] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBA9] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:07:32.623980] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:32.624010] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:32.624019] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:32.663613] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=17] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:32.663677] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:32.663693] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:32.664704] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E145] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.665219] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E146] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.665654] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E147] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.666147] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E148] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.684863] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:32.684972] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=43] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276451493405, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-834, last_round_trip_time:829, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:32.685001] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:32.685002] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:32.685043] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276452191434, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-848, last_round_trip_time:812, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:32.685055] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:32.921448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D1A] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.922243] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D1B] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:07:32.922904] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D1C] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.923560] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D1D] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:32.924218] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D1E] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:32.924763] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D1F] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:32.925279] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D20] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:33.276500] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E048] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:33.309983] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E048] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:33.310001] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E048] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:33.310010] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E048] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:33.310033] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E048] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:33.310133] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E02C] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:33.310234] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E048] [lt=111] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:33.310248] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E048] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:33.338086] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E02C] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:33.338119] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E02C] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:33.338129] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E02C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:33.338152] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E02C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:33.338240] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E072] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:33.338261] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E02C] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:33.338274] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E02C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:33.389518] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E072] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:33.389556] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E072] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:33.389566] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E072] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:33.389591] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E072] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:33.389686] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E072] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:33.389699] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E072] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:33.389720] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:33.389737] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:33.389799] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:33.390493] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=12] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:33.390729] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:33.391584] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:33.391591] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:33.391771] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:33.392630] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:33.392636] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:33.392817] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:33.392838] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:33.392846] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:33.392922] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:33.392936] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:07:33.394325] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:33.394389] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:33.394425] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=33] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:33.396786] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:33.398387] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:33.494479] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428505] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:33.494521] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428505] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:33.494533] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428505] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:33.494549] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428505] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:07:33.626728] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:33.626756] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:33.626766] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:33.641996] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:33.642007] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:33.687251] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:33.687264] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:33.687300] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276452191434, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-848, last_round_trip_time:812, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:33.687334] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:33.687307] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276453494447, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-887, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:33.687364] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=52] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:33.838691] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=8] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:33.838704] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:33.838717] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=8] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=156) [2024-01-03 18:07:33.838727] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:33.838735] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:33.838746] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=7] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=644020356) [2024-01-03 18:07:33.838778] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:33.838788] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E074] [lt=8] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:33.838822] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E075] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:07:33.838927] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E075] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:34.192747] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994495] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:34.192799] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994495] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:34.192815] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994495] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:34.192834] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994495] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:07:34.267433] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528DFF] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.268185] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E00] [lt=78] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:07:34.268880] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E01] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.269477] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E02] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:34.270200] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E03] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.270693] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E04] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:34.271195] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E05] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.310461] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E061] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:34.342606] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42845B] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:34.344279] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E061] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:34.344316] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E061] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:34.344326] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E061] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:34.344353] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E061] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:34.344468] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E02F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:34.344514] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E061] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:34.344531] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E061] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:34.379230] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E02F] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:34.379269] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E02F] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:34.379280] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E02F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:34.379315] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E02F] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:34.379464] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E02F] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:34.379487] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E02F] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:34.389846] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E04B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:34.419044] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E04B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:34.419082] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E04B] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:34.419092] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E04B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:34.419116] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E04B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:34.419212] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E04B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:34.419227] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E04B] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:34.603736] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAA] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:34.603778] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAA] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:34.603789] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:34.603806] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:07:34.629216] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:34.629245] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:34.629254] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:34.667107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E149] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.667702] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF0-00060E079A34E14A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.668158] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E14B] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.668760] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E14C] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.689988] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:34.690038] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276454192717, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-870, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:34.690051] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:34.690072] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:34.690116] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276453494447, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-887, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:34.690128] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:34.926334] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D21] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.927086] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D22] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:34.927776] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D23] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.928376] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D24] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:34.928832] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D25] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.929287] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D26] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:34.929926] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D27] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:34.982154] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB07] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:35.344741] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E04C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:35.375530] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E04C] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:35.375547] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E04C] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:35.375560] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E04C] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:35.375584] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E04C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:35.375707] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E04C] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:35.375720] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E04C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:35.379649] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E078] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:35.409217] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E078] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:35.409259] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E078] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:35.409276] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E078] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:35.409310] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E078] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:35.409430] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E078] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:35.409444] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E078] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:35.419423] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E064] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:35.450471] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E064] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:35.450507] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E064] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:35.450517] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E064] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:35.450541] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E064] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:35.450639] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E064] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:35.450652] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E064] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:35.495557] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428506] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:35.495616] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428506] [lt=55] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:35.495628] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428506] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:35.495644] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428506] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:07:35.631472] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:35.631501] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:35.631510] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:35.692709] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:35.692762] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276455495514, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-836, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:35.692774] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:35.693163] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:35.693225] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276454192717, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-870, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:35.693261] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:35.708440] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E1] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:36.193842] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994496] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:36.193869] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994496] [lt=25] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:36.193880] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994496] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:36.193896] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994496] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:07:36.375881] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E065] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:36.407858] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E065] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:36.407888] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E065] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:36.407898] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E065] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:36.407942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E065] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:36.408061] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E065] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:36.408074] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E065] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:36.409706] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E034] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:36.413911] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E07] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.414686] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E08] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=45, ddl_arg=NULL) [2024-01-03 18:07:36.415371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF1-00060E079C528E09] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.416005] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E0A] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:36.416564] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E0B] [lt=62] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.417101] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E0C] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:36.417583] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E0D] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.439062] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E034] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:36.439103] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E034] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:36.439120] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E034] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:36.439153] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E034] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:36.439317] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E034] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:36.439331] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E034] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:36.450774] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E07B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:36.476387] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E07B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:36.476421] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E07B] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:36.476430] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E07B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:36.476456] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E07B] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:36.476549] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E07B] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:36.476561] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E07B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:36.604597] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:36.604639] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAB] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:36.604650] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:36.604667] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAB] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:07:36.633965] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:36.633994] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:36.634003] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:36.669685] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E14D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.670163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E14E] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.670568] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E14F] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.671067] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E150] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:36.695136] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=71] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:36.695190] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276455495514, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-836, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:36.695203] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:36.695707] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:36.695753] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276456193805, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-988, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:36.695779] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:37.059537] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D29] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:37.060065] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D2A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:37.060605] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF2-00060E079EC94D2B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:37.061221] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D2C] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=87, ddl_arg=NULL) [2024-01-03 18:07:37.061790] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D2D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:37.062283] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D2E] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:37.062820] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D2F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:37.408238] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E07C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:37.438465] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E07C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:37.438499] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E07C] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:37.438509] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E07C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:37.438531] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E07C] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:37.438653] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E07C] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:37.438666] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E07C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:37.439480] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E051] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:37.465730] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E051] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:37.465763] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E051] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:37.465772] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E051] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:37.465794] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E051] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:37.465897] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E051] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:37.465916] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E051] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:37.476709] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E068] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:37.496708] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428507] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:37.496748] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428507] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:37.496785] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428507] [lt=34] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:37.496804] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428507] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:07:37.509028] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E068] [lt=31] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:37.509068] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E068] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:37.509078] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E068] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:37.509102] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E068] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:37.509199] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E068] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:37.509212] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E068] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:37.509232] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:37.509250] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:37.509316] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=22] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:37.510070] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=20] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:37.510322] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=18] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:37.511317] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=44] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:37.511330] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:37.511601] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=11] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:37.512429] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:37.512436] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:37.512609] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=11] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:37.512631] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:37.512639] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:07:37.512716] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:37.512731] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:07:37.514019] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:37.514075] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:37.514086] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:37.516626] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:37.518211] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:37.636314] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:37.636334] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:37.636348] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:37.664993] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:37.665026] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=14] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:37.665043] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:37.698096] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:37.698150] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276457496677, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-822, last_round_trip_time:802, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:37.698162] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:37.698450] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:37.698492] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276456193805, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-988, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:37.698512] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:37.741776] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:37.741794] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=14] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:37.929047] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:37.929056] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:37.929067] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=157) [2024-01-03 18:07:37.929075] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:37.929082] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:37.929090] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=648110702) [2024-01-03 18:07:37.929116] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:37.929136] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E06A] [lt=18] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:37.929163] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E06B] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:37.929306] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E06B] [lt=19] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:38.194866] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994497] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:38.194899] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994497] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:38.194908] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994497] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:38.194923] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994497] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=87, ddl_arg=NULL) [2024-01-03 18:07:38.418511] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E0E] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.419354] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E0F] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:07:38.420176] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E10] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.420749] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E11] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:38.421243] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E12] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.421748] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E13] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:38.422260] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E14] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.438801] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E039] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:38.467969] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E039] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:38.468003] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E039] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:38.468013] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E039] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:38.468035] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E039] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:38.468097] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E07F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:38.468196] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E039] [lt=70] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:38.468210] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E039] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:38.499452] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E07F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:38.499486] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E07F] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:38.499495] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E07F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:38.499518] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E07F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:38.499608] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E07F] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:38.499620] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E07F] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:38.509343] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E054] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:38.537508] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E054] [lt=62] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:38.537525] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E054] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:38.537535] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E054] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:38.537558] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E054] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:38.537653] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E054] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:38.537665] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E054] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:38.605499] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAC] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:38.605542] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAC] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:38.605554] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:38.605570] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:07:38.639284] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:38.639338] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=45] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:38.639350] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:38.671940] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E152] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.672635] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E153] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.673044] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E154] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.673489] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E155] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:38.700670] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:38.700725] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276457496677, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-822, last_round_trip_time:802, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:38.700737] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:38.700943] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:38.701049] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=66] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276458194839, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-903, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:38.701077] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:39.063767] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D30] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:39.064456] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D31] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:39.065057] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D32] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:39.065735] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D33] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:39.066233] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D34] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:39.066751] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D35] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:39.067260] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D36] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:39.343327] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42845C] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:39.468349] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E055] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:39.496736] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E055] [lt=20] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:39.496777] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E055] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:39.496787] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E055] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:39.496811] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E055] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:39.496900] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E055] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:39.496913] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E055] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:39.497756] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428508] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:39.497786] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428508] [lt=27] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:39.497795] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428508] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:39.497814] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428508] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=86, ddl_arg=NULL) [2024-01-03 18:07:39.499756] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E06E] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:39.529488] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E06E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:39.529524] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E06E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:39.529533] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E06E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:39.529557] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E06E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:39.529657] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E06E] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:39.529669] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E06E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:39.537797] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E03C] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:39.564728] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E03C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:39.564763] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E03C] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:39.564773] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E03C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:39.564795] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E03C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:39.564890] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E03C] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:39.564902] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E03C] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:39.642039] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=68] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:39.642059] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:39.642073] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:39.703006] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:39.703054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276459497731, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-835, last_round_trip_time:805, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:39.703067] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:39.703392] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:39.703433] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276458194839, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-903, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:39.703445] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:39.982786] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB08] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:40.196039] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994498] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:40.196073] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994498] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:40.196082] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994498] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:40.196121] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994498] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=124, ddl_arg=NULL) [2024-01-03 18:07:40.423090] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E15] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.423770] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E16] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:40.424472] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E17] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.425150] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E18] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:40.425724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E19] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.426299] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E1A] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:40.426869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E1B] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.497025] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E03D] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:40.528169] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E03D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:40.528204] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E03D] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:40.528215] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E03D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:40.528237] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E03D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:40.528333] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E03D] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:40.528345] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E03D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:40.529831] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E084] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:40.558890] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E084] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:40.558938] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E084] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:40.558977] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E084] [lt=36] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:40.559010] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E084] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:40.559122] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E084] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:40.559136] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E084] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:40.565104] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E058] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:40.597073] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E058] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:40.597112] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E058] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:40.597123] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E058] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:40.597146] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E058] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:40.597280] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E058] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:40.597293] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E058] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:40.606362] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAD] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:40.606404] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAD] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:40.606419] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAD] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:40.606444] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAD] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:07:40.644502] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:40.644531] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:40.644540] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:40.674255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E156] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.674708] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E157] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.675186] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E158] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.675587] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E159] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:40.705636] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:40.705644] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:40.705684] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276459497731, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-835, last_round_trip_time:805, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:40.705686] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276460196000, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-928, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:40.705770] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=78] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:40.705731] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:40.709228] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E2] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:41.068076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D37] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:41.068835] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D38] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:41.069505] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D39] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:41.070093] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D3A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:41.070609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D3B] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:41.071156] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D3C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:41.071789] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF2-00060E079EC94D3D] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:41.498961] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428509] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:41.498999] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428509] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:41.499012] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428509] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:41.499028] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428509] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:07:41.528502] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E059] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:41.563907] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E059] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:41.563944] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E059] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:41.563990] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E059] [lt=44] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:41.564014] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E059] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:41.564084] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E073] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:41.564123] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E059] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:41.564135] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E059] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:41.592438] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E073] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:41.592475] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E073] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:41.592484] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E073] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:41.592507] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E073] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:41.592603] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E073] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:41.592615] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E073] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:41.597472] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E087] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:41.627499] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E087] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:41.627527] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E087] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:41.627536] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E087] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:41.627560] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E087] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:41.627660] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E087] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:41.627674] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E087] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:41.627695] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:41.627712] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:41.627756] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:41.628466] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:41.628656] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:41.629612] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=74] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:41.629639] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=25] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:41.629901] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=59] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:41.630694] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:41.630700] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:41.630885] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:41.630908] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:41.630916] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:41.631016] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:41.631038] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=21] [dc=0] broadcast root address succeed [2024-01-03 18:07:41.632744] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:41.632801] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:41.632825] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:41.635106] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:41.636991] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=66] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:41.647506] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:41.647519] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:41.647530] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:41.709002] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:41.709074] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276461498876, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-714, last_round_trip_time:800, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:41.709093] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:41.709997] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:41.710057] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276460196000, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-928, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:41.710098] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:41.874033] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:41.874043] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:42.078534] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=13] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:42.078544] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:42.078556] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=158) [2024-01-03 18:07:42.078565] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:42.078573] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:42.078580] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=652260192) [2024-01-03 18:07:42.078607] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:42.078623] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E089] [lt=14] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:42.078651] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E08A] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:42.078792] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E08A] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:42.197095] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994499] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:42.197152] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994499] [lt=51] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:42.197170] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994499] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:42.197192] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994499] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:07:42.427795] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E1D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.428460] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E1E] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:42.429089] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E1F] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.429679] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF1-00060E079C528E20] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=33, ddl_arg=NULL) [2024-01-03 18:07:42.430259] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E21] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.430796] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E22] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:42.431254] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E23] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.564284] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E042] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:42.593139] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E042] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:42.593179] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E042] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:42.593188] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E042] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:42.593210] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E042] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:42.593265] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E076] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:42.593311] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E042] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:42.593324] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E042] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:42.607330] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAE] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:42.607350] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAE] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:42.607361] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:42.607378] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAE] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=80, ddl_arg=NULL) [2024-01-03 18:07:42.621643] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E076] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:42.621678] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E076] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:42.621692] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E076] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:42.621724] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E076] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:42.621819] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E076] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:42.621830] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E076] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:42.627804] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E05C] [lt=27] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:42.650294] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:42.650331] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:42.650347] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:42.657201] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E05C] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:42.657243] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E05C] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:42.657259] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E05C] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:42.657291] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E05C] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:42.657396] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E05C] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:42.657409] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E05C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:42.711551] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:42.711601] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276461498876, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-714, last_round_trip_time:800, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:42.711645] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:42.712733] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:42.712786] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276462197055, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-984, last_round_trip_time:822, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:42.712798] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:42.815456] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:42.815522] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=43] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:42.815558] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=24] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:42.816566] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E15B] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.816986] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E15C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.817398] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E15D] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:42.817773] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E15E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:43.072737] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D3F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:43.073550] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D40] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=39, ddl_arg=NULL) [2024-01-03 18:07:43.074154] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D41] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:43.074681] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D42] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:43.075234] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D43] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:43.075820] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D44] [lt=54] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:43.076383] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D45] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:43.500139] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:43.500158] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850A] [lt=16] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:43.500168] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850A] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:43.500183] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=76, ddl_arg=NULL) [2024-01-03 18:07:43.593451] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E08D] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:43.626759] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E08D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:43.626804] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E08D] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:43.626818] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E08D] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:43.626853] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E08D] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:43.626965] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E05D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:43.627025] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E08D] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:43.627044] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E08D] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:43.653165] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=48] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:43.653191] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=20] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:43.653200] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:43.655993] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E05D] [lt=87] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:43.656048] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E05D] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:43.656057] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E05D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:43.656081] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E05D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:43.656166] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E05D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:43.656179] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E05D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:43.657555] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E079] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:43.689465] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E079] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:43.689503] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E079] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:43.689513] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E079] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:43.689537] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E079] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:43.689637] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E079] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:43.689651] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E079] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:43.714572] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:43.714647] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276463500110, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-626, last_round_trip_time:789, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:43.714670] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:43.715199] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:43.715241] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276462197055, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-984, last_round_trip_time:822, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:43.715252] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:44.198001] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449A] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:44.198039] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449A] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:44.198055] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449A] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:44.198071] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:07:44.344307] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42845D] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:44.432172] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E24] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.432852] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E25] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:44.433487] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E26] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.434116] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E27] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:44.434828] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2003][454][YB42C0A86EF1-00060E079C528E28] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.435387] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E29] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:44.435931] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E2A] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.608107] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBAF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:44.608149] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBAF] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:44.608161] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBAF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:44.608177] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBAF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:07:44.627187] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E05E] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:44.655581] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:44.655615] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:44.655624] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:44.659164] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E05E] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:44.659219] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E05E] [lt=51] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:44.659238] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E05E] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:44.659270] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E05E] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:44.659340] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E090] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:44.659411] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E05E] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:44.659430] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E05E] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:44.688181] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E090] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:44.688225] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E090] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:44.688240] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E090] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:44.688271] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E090] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:44.688387] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E090] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:44.688399] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E090] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:44.689803] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E049] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:44.717587] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:44.717660] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276463500110, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-626, last_round_trip_time:789, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:44.717674] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:44.718116] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:44.718159] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276464197937, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:44.718184] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:44.723835] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E049] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:44.723880] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E049] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:44.723899] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E049] [lt=17] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:44.723933] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E049] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:44.724091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E049] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:44.724110] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E049] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:44.818601] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF0-00060E079A34E15F] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.819128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E160] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.819671] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E161] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.820164] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E162] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:44.983415] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB09] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:45.077262] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D46] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:45.077964] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D47] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:45.078660] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D48] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:45.079316] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D49] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:45.079805] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D4A] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:45.080272] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D4B] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:45.080736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D4C] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:45.501359] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:45.501389] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850B] [lt=27] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:45.501400] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:45.501416] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850B] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:07:45.658385] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:45.658398] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:45.658407] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:45.659540] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E07E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:45.687152] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E07E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:45.687190] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E07E] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:45.687200] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E07E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:45.687223] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E07E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:45.687314] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E07E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:45.687326] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E07E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:45.688553] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E061] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:45.710165] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E3] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:07:45.718495] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E061] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:45.718533] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E061] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:45.718543] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E061] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:45.718566] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E061] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:45.718662] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E061] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:45.718680] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E061] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:45.718713] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:45.718729] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:45.718804] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:45.719584] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:45.719752] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:45.720660] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:45.720667] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:45.720789] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:45.720848] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276464197937, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:45.720825] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:45.720871] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:45.721027] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:45.721089] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276465501328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-748, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:45.721124] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:45.721878] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=36] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:45.721889] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:45.722143] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:45.722172] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=24] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:45.722184] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:07:45.722298] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:45.722311] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:07:45.723761] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:45.723822] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:45.723833] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:45.724268] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E07F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:45.726214] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:45.728030] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=51] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:45.759030] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E07F] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:45.759068] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E07F] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:45.759078] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E07F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:45.759124] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E07F] [lt=30] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:45.759217] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E07F] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:45.759229] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E07F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:45.955440] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:45.955462] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=18] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:46.154512] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:46.154523] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:46.154535] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=159) [2024-01-03 18:07:46.154543] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:46.154551] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:46.154559] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=656336171) [2024-01-03 18:07:46.154586] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:46.154607] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E063] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:46.154635] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E064] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:46.154764] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E064] [lt=11] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:46.199016] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449B] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:46.199062] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449B] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:46.199074] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449B] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:46.199089] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449B] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:07:46.576815] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF1-00060E079C528E2C] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.577506] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E2D] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:07:46.578155] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E2E] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.578816] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E2F] [lt=69] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:46.579393] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E30] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.580003] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E31] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:46.580590] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E32] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.608907] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB0] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:46.608943] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB0] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:46.608973] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB0] [lt=28] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:46.608989] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:07:46.660172] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:46.660195] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:46.660202] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:46.687450] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E04C] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:46.719712] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E04C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:46.719752] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E04C] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:46.719762] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E04C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:46.719785] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E04C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:46.719860] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E080] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:46.719940] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E04C] [lt=63] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:46.719974] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E04C] [lt=28] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:46.722943] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:46.722999] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276465501328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-748, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:46.723008] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:46.723988] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=54] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:46.724054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276466198986, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-969, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:46.724088] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:46.752919] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E080] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:46.752984] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E080] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:46.752998] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E080] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:46.753030] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E080] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:46.753172] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E080] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:46.753190] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E080] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:46.759385] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E04D] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:46.789291] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E04D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:46.789328] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E04D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:46.789338] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E04D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:46.789361] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E04D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:46.789480] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E04D] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:46.789492] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E04D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:46.821074] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E163] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.821499] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E164] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.821942] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E165] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:46.822345] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E166] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:47.209071] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D4E] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:47.209732] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D4F] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:47.210274] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D50] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:47.210718] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D51] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:47.211160] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D52] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:47.211621] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D53] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:47.212054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D54] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:47.502448] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850C] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:47.502488] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850C] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:47.502499] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:47.502516] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850C] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:07:47.662891] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:47.662920] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:47.662929] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:47.720075] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E067] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:47.725648] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:47.725703] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276467502418, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-794, last_round_trip_time:826, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:47.725745] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:47.726704] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=41] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:47.726764] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276466198986, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-969, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:47.726777] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:47.750697] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E067] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:47.750732] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E067] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:47.750742] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E067] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:47.750765] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E067] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:47.750859] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E067] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:47.750871] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E067] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:47.753345] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E09B] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:47.783492] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E09B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:47.783527] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E09B] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:47.783536] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E09B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:47.783560] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E09B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:47.783662] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E09B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:47.783674] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E09B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:47.789644] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E083] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:47.817009] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:47.817074] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=41] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:47.817110] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=24] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:47.819371] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E083] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:47.819408] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E083] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:47.819418] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E083] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:47.819440] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E083] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:47.819543] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E083] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:47.819556] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E083] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:48.200118] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449C] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:48.200155] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449C] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:48.200166] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:48.200182] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449C] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:07:48.581891] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E33] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.582575] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E34] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:48.583264] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E35] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.583894] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E36] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:48.584454] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E37] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.584944] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E38] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:48.585639] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E39] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.609682] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:48.609718] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB1] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:48.609728] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB1] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:48.609744] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:07:48.665566] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:48.665595] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:48.665605] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:48.728875] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:48.728925] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276467502418, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-794, last_round_trip_time:826, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:48.728937] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:48.729298] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:48.729341] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276468200088, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-943, last_round_trip_time:806, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:48.729360] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:48.751031] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E084] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:48.782926] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E084] [lt=43] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:48.782980] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E084] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:48.782991] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E084] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:48.783014] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E084] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:48.783115] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E084] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:48.783127] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E084] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:48.783859] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E052] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:48.814190] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E052] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:48.814232] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E052] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:48.814243] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E052] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:48.814265] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E052] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:48.814357] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E052] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:48.814370] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E052] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:48.819720] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E06A] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:48.823121] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E168] [lt=62] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.823665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E169] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.824181] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16A] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.824688] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16B] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:48.847899] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E06A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:48.847935] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E06A] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:48.847944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E06A] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:48.848002] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E06A] [lt=41] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:48.848102] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E06A] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:48.848119] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E06A] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:49.212929] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D55] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:49.213649] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D56] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:07:49.214344] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D57] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:49.215032] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D58] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:49.215824] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:49.216352] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D5A] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:49.216904] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF2-00060E079EC94D5B] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:49.345147] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42845E] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:49.503461] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850D] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:49.503502] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:49.503521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850D] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:49.503542] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850D] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:07:49.668302] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:49.668332] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:49.668342] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:49.731411] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:49.731462] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276469503431, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-766, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:49.731474] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:49.731607] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:49.731649] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276468200088, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-943, last_round_trip_time:806, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:49.731675] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:49.731695] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:49.731708] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:49.731762] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:49.732529] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=52] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:49.732781] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=25] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:49.733700] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:49.733712] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:49.733980] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:49.734765] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:49.734772] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:49.735019] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:49.735043] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:49.735051] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:49.735131] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:49.735185] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=52] [dc=0] broadcast root address succeed [2024-01-03 18:07:49.736466] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:49.736522] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:49.736547] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=23] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:49.739228] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:49.740816] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=18] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:49.783278] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E06B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:49.810931] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E06B] [lt=84] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:49.811021] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E06B] [lt=87] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:49.811033] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E06B] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:49.811056] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E06B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:49.811143] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E06B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:49.811156] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E06B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:49.814513] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0A0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:49.842467] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0A0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:49.842518] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0A0] [lt=48] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:49.842528] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0A0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:49.842551] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0A0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:49.842673] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0A0] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:49.842686] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0A0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:49.848252] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E087] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:49.877063] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E087] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:49.877097] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E087] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:49.877106] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E087] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:49.877132] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E087] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:49.877229] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E087] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:49.877241] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E087] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:49.980289] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:49.980299] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:49.984066] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB0A] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:07:50.189926] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:50.189940] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:50.189970] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=24] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=160) [2024-01-03 18:07:50.189979] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:50.189987] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:50.189995] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=660371607) [2024-01-03 18:07:50.190022] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:50.190044] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E056] [lt=20] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:50.190071] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E057] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:50.190194] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E057] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:50.201219] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449D] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:50.201260] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449D] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:50.201271] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449D] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:50.201287] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449D] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:07:50.586629] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E3A] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.587316] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E3B] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:50.588057] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E3C] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.588608] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E3D] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:50.589128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E3E] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.589593] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E3F] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:50.590100] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E40] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.610527] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:50.610564] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB2] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:50.610576] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB2] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:50.610592] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB2] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:07:50.671461] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:50.671499] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:50.671515] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:50.710901] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E4] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:50.733878] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:50.733928] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276469503431, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-766, last_round_trip_time:823, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:50.733940] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:50.734653] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:50.734715] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276470201188, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:50.734746] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:50.811301] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E058] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:50.825526] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16C] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.826053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16D] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.826493] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.826896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E16F] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:50.840569] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E058] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:50.840604] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E058] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:50.840614] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E058] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:50.840638] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E058] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:50.840743] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E058] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:50.840756] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E058] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:50.842824] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E06E] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:50.871486] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E06E] [lt=20] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:50.871531] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E06E] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:50.871548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E06E] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:50.871584] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E06E] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:50.871744] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E06E] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:50.871756] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E06E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:50.877380] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0A3] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:50.908906] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0A3] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:50.908941] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0A3] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:50.908984] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0A3] [lt=41] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:50.909007] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0A3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:50.909105] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0A3] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:50.909118] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0A3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:51.217808] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D5C] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:51.218467] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D5D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=38, ddl_arg=NULL) [2024-01-03 18:07:51.219035] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D5E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:51.219571] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF2-00060E079EC94D5F] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:07:51.220082] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D60] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:51.220570] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D61] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:51.221075] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D62] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:51.504583] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850E] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:51.504624] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850E] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:51.504636] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:51.504655] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850E] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=147, ddl_arg=NULL) [2024-01-03 18:07:51.674190] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:51.674226] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:51.674235] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:51.736518] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:51.736569] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276471504543, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:51.736583] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:51.737387] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:51.737431] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276470201188, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:51.737451] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:51.840870] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0A4] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:51.869687] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0A4] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:51.869724] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0A4] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:51.869734] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0A4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:51.869757] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0A4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:51.869853] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0A4] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:51.869865] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0A4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:51.871900] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E08C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:51.900613] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E08C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:51.900650] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E08C] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:51.900664] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E08C] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:51.900687] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E08C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:51.900790] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E08C] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:51.900803] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E08C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:51.909236] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E05B] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:51.935816] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E05B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:51.935850] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E05B] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:51.935859] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E05B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:51.935882] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E05B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:51.935992] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E05B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:51.936005] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E05B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:52.202292] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449E] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:52.202338] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449E] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:52.202389] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449E] [lt=46] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:52.202414] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449E] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:07:52.591061] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E42] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.591795] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E43] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:07:52.592474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E44] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.593038] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E45] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:52.593570] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E46] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.594052] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E47] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:07:52.594476] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E48] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.611440] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB3] [lt=30] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:52.611495] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB3] [lt=51] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:52.611506] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:52.611551] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:07:52.677298] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:52.677331] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:52.677342] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:52.739457] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=77] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:52.739528] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276471504543, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:52.739550] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:52.739910] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:52.739976] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276472202261, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-965, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:52.740007] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:52.870057] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E05C] [lt=19] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:52.900818] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E05C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:52.900855] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E05C] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:52.900864] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E05C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:52.900889] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E05C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:52.900981] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E073] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:52.901073] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E05C] [lt=83] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:52.901088] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E05C] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:52.932643] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E073] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:52.932686] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E073] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:52.932703] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E073] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:52.932736] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E073] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:52.932891] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E073] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:52.932904] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E073] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:52.936162] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0A7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:52.967722] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0A7] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:52.967739] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0A7] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:52.967749] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0A7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:52.967772] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0A7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:52.967865] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0A7] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:52.967879] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0A7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:52.979460] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=33] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:52.979541] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=44] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:52.979592] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=35] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:52.980516] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E171] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.981048] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E172] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.981493] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E173] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:52.982001] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E174] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:53.221995] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D64] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:53.222925] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D65] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=48, ddl_arg=NULL) [2024-01-03 18:07:53.223614] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D66] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:53.224237] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D67] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:53.224827] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D68] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:53.225407] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D69] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:53.225993] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D6A] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:53.505788] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42850F] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:53.505840] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42850F] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:53.505859] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42850F] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:53.505879] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42850F] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:07:53.679785] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:53.679814] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:53.679824] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:53.742351] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:53.742441] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276473505757, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-807, last_round_trip_time:857, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:53.742491] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:53.743205] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:53.743248] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276472202261, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-965, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:53.743273] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:53.743293] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:53.743307] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:53.743371] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:53.744175] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:53.744408] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:53.745316] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:53.745323] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:53.745538] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:53.746434] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:53.746441] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:53.746730] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:53.746753] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:53.746761] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:53.746840] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:53.746889] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=48] [dc=0] broadcast root address succeed [2024-01-03 18:07:53.748294] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:53.748348] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:53.748372] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:53.751522] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:53.753699] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:53.901227] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0A8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:53.933271] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0A8] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:53.933308] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0A8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:53.933318] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0A8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:53.933341] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0A8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:53.933397] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E091] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:53.933445] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0A8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:53.933457] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0A8] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:53.966777] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E091] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:53.966796] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E091] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:53.966806] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E091] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:53.966830] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E091] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:53.967001] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E091] [lt=56] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:53.967015] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E091] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:53.968025] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E05F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:54.000451] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E05F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:54.000487] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E05F] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:54.000497] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E05F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:54.000522] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E05F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:54.000626] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E05F] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:54.000640] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E05F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:54.015394] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:54.015405] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:54.203528] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99449F] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:54.203570] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99449F] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:54.203587] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99449F] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:54.203609] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99449F] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=124, ddl_arg=NULL) [2024-01-03 18:07:54.327153] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:54.327164] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:54.327175] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=161) [2024-01-03 18:07:54.327182] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:54.327189] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:54.327196] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=664508808) [2024-01-03 18:07:54.327223] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:54.327231] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E077] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:54.327258] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E078] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:54.327387] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E078] [lt=19] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:54.345805] INFO [RS] ob_rs_rpc_processor.h:196 [2018][484][YB42C0A86EF1-00060E079C42845F] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:54.595398] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E49] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.596186] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E4A] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:07:54.597001] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E4B] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.597615] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E4C] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:54.598143] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E4D] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.598645] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E4E] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:54.599090] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E4F] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.612443] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB4] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:54.612483] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB4] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:54.612495] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:54.612512] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:07:54.682524] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:54.682538] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:54.682572] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:54.745010] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:54.745018] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:54.745047] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=4] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276474203491, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-938, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:54.745056] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:54.745060] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276473505757, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-807, last_round_trip_time:857, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:54.745072] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:54.933634] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E079] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:54.964202] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E079] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:54.964240] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E079] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:54.964252] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E079] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:54.964277] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E079] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:54.964378] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E079] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:54.964392] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E079] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:54.967153] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0AB] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:54.983010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E175] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.983429] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E176] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.983930] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E177] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.984467] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E178] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:54.984708] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB0B] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:07:55.002061] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0AB] [lt=23] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:55.002102] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0AB] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:55.002113] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0AB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:55.002137] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0AB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:55.002217] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E062] [lt=5] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:55.002252] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0AB] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:55.002267] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0AB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:55.032282] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E062] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:55.032318] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E062] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:55.032328] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E062] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:55.032352] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E062] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:55.032455] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E062] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:55.032470] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E062] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:55.227105] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D6B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:55.227928] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D6C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:07:55.228711] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D6D] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:55.229287] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D6E] [lt=72] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:55.229844] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D6F] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:55.230393] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D70] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:07:55.230927] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D71] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:55.506919] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428510] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:55.506984] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428510] [lt=61] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:55.507000] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428510] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:55.507018] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428510] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=134, ddl_arg=NULL) [2024-01-03 18:07:55.685150] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:55.685179] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:55.685188] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:55.711696] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E5] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:07:55.747636] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:55.747686] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276474203491, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-938, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:55.747699] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:55.747919] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:55.748006] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276475506887, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-805, last_round_trip_time:874, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:55.748044] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:55.964568] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E063] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:55.998081] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E063] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:55.998124] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E063] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:55.998141] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E063] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:55.998172] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E063] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:55.998312] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E063] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:55.998331] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E063] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:56.002429] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E096] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:56.032380] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E096] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:56.032418] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E096] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:56.032428] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E096] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:56.032453] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E096] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:56.032560] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E096] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:56.032580] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E096] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:56.032640] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E07C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:56.063291] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E07C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:56.063359] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E07C] [lt=65] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:56.063369] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E07C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:56.063394] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E07C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:56.063558] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E07C] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:56.063573] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E07C] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:56.204626] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:56.204667] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A0] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:56.204679] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:56.204696] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A0] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:07:56.613305] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB5] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:56.613354] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB5] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:56.613371] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB5] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:56.613391] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB5] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:07:56.687992] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:56.688023] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:56.688033] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:56.728707] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E51] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.729309] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E52] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:07:56.730026] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E53] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.730562] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E54] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:56.731074] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E55] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.731554] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E56] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:56.732065] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E57] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.750385] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:56.750435] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276476204593, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1012, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:56.750447] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:56.750517] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:56.750561] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276475506887, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-805, last_round_trip_time:874, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:56.750587] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:56.985433] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E179] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.985855] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E17A] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.986280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E17B] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.986738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E17C] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:56.998500] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E07D] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:57.027588] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E07D] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:57.027622] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E07D] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:57.027636] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E07D] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:57.027660] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E07D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:57.027759] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E07D] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:57.027773] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E07D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:57.032724] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0B0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:57.066933] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0B0] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:57.066988] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0B0] [lt=53] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:57.066999] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0B0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:57.067022] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0B0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:57.067092] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E066] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:57.067185] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0B0] [lt=72] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:57.067199] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0B0] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:57.098245] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E066] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:57.098280] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E066] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:57.098292] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E066] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:57.098315] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E066] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:57.098413] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E066] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:57.098425] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E066] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:57.359663] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D73] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:57.360369] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D74] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:07:57.360925] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF2-00060E079EC94D75] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:57.361443] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D76] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:57.361899] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF2-00060E079EC94D77] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:57.362381] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D78] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:57.362849] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D79] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:57.507889] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428511] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:57.507936] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428511] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:57.507977] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428511] [lt=37] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:57.507995] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428511] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=153, ddl_arg=NULL) [2024-01-03 18:07:57.690272] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:57.690300] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:57.690309] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:57.752869] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:57.752919] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276477507846, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-829, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:57.752931] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:57.753097] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=74] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:57.753141] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276476204593, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1012, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:57.753167] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:57.753188] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:07:57.753202] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:07:57.753261] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:07:57.754088] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:07:57.754339] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:07:57.755397] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:57.755405] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:57.755635] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:07:57.758225] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:07:57.758236] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:07:57.758420] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:07:57.758441] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:07:57.758449] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:07:57.758578] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=33] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:07:57.758608] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=28] [dc=0] broadcast root address succeed [2024-01-03 18:07:57.760028] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:07:57.760097] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=52] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:57.760165] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=65] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:07:57.762431] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:07:57.764034] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:07:57.981033] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:57.981066] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=15] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:57.981082] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:07:58.008070] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=7] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:07:58.008080] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:07:58.027935] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E067] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:58.059325] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E067] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:58.059362] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E067] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:58.059372] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E067] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:58.059395] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E067] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:58.059486] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E067] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:58.059499] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E067] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:58.067319] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E09B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:58.129202] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0B3] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:58.129244] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0B3] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:58.129259] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0B3] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:58.129290] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0B3] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:58.129462] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0B3] [lt=53] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:58.129499] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0B3] [lt=28] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:58.205575] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:58.205615] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A1] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:58.205627] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A1] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:58.205643] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:07:58.212104] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:58.212114] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:07:58.212125] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=162) [2024-01-03 18:07:58.212134] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:07:58.212141] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:07:58.212149] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=668393761) [2024-01-03 18:07:58.212179] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:07:58.212194] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E081] [lt=14] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:07:58.212222] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E082] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:07:58.212355] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E082] [lt=16] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:07:58.614069] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:58.614109] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB6] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:58.614121] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB6] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:58.614136] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:07:58.693037] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:58.693070] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:58.693079] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:58.732997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF1-00060E079C528E58] [lt=103] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.733700] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E59] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:07:58.734364] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E5A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.734933] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E5B] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:07:58.735467] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E5C] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.736043] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E5D] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:07:58.736603] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E5E] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.755578] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:58.755627] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276478205545, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1088, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:58.755642] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:58.755675] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:58.755796] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=66] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276477507846, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-829, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:58.755835] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:58.987602] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E17E] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.988182] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E17F] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.988584] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E180] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:58.989027] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E181] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:59.059653] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E083] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:59.087130] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E083] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:59.087155] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E083] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:59.087164] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E083] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:59.087187] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E083] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:59.087284] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E083] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:59.087297] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E083] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:59.096481] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E06A] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:59.124836] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E06A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:59.124863] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E06A] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:59.124872] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E06A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:59.124895] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E06A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:59.125006] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E06A] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:59.125018] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E06A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:59.129640] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0B6] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:07:59.158991] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0B6] [lt=30] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:07:59.159023] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0B6] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:07:59.159033] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0B6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:07:59.159063] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0B6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:07:59.159192] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0B6] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:07:59.159212] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0B6] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:07:59.346685] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428460] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:07:59.363766] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D7A] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:59.364632] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D7B] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:07:59.365303] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D7C] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:59.365943] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D7D] [lt=80] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:07:59.366572] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D7E] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:59.367049] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D7F] [lt=58] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:07:59.367572] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D80] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:07:59.509134] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428512] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:07:59.509173] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428512] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:07:59.509185] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428512] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:07:59.509202] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428512] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:07:59.695545] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:07:59.695584] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:07:59.695593] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:07:59.759682] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:59.759732] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276478205545, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1088, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:59.759755] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=19] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:07:59.760097] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:07:59.760139] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276479509104, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-733, last_round_trip_time:874, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:07:59.760164] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:07:59.985484] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB0C] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:00.087434] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0B7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:00.120644] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0B7] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:00.120678] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0B7] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:00.120687] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0B7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:00.120710] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0B7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:00.120807] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0B7] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:00.120820] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0B7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:00.125122] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0A0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:00.155562] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0A0] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:00.155610] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0A0] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:00.155627] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0A0] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:00.155660] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0A0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:00.155824] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0A0] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:00.155841] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0A0] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:00.159355] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E086] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:00.188649] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E086] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:00.188685] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E086] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:00.188695] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E086] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:00.188723] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E086] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:00.188850] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E086] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:00.188863] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E086] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:00.206609] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:00.206647] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A2] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:00.206658] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A2] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:00.206674] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A2] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=114, ddl_arg=NULL) [2024-01-03 18:08:00.614834] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB7] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:00.614872] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB7] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:00.614884] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB7] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:00.614900] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB7] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:08:00.698299] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:00.698328] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:00.698338] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:00.712559] INFO [RS] ob_rs_rpc_processor.h:196 [2019][486][YB42C0A86EF2-00060E079EA943E6] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:00.737756] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E5F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.738375] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E60] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:00.739014] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E61] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.739526] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E62] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:00.740027] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E63] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.740484] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E64] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:00.740965] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E65] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.762737] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:00.762762] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:00.762796] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276479509104, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-733, last_round_trip_time:874, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:00.762807] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:00.762828] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276480206563, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:00.762847] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:00.989879] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E182] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.990491] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E183] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.991014] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E184] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:00.991349] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E185] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:01.121070] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E087] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:01.150383] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E087] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:01.150411] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E087] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:01.150419] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E087] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:01.150439] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E087] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:01.150526] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E087] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:01.150539] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E087] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:01.156008] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E06F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:01.185616] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E06F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:01.185652] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E06F] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:01.185662] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E06F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:01.185690] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E06F] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:01.185791] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E06F] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:01.185805] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E06F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:01.189010] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0A3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:01.220002] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0A3] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:01.220031] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0A3] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:01.220041] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0A3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:01.220065] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0A3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:01.220170] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0A3] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:01.220184] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0A3] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:01.377332] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D81] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:01.378121] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D82] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:08:01.378786] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D83] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:01.379476] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D84] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:01.380285] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D85] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:01.380875] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D86] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:01.381438] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D87] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:01.510375] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428513] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:01.510422] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428513] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:01.510441] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428513] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:01.510466] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428513] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:08:01.700801] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:01.700831] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:01.700841] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:01.765506] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:01.765558] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276481510326, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-682, last_round_trip_time:889, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:01.765571] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:01.765593] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:01.765607] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:01.765634] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:01.765659] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:01.765676] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276480206563, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:01.765705] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:01.766466] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:01.766661] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:01.767556] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:01.767563] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:01.767770] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:01.768751] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:01.768758] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:01.768935] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:01.768994] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=56] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:01.769002] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:01.769084] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=25] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:01.769106] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=21] [dc=0] broadcast root address succeed [2024-01-03 18:08:01.770354] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:01.770414] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:01.770473] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=56] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:01.772623] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:01.774298] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=70] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:02.051119] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=15] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:02.051153] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=28] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:02.150674] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0A4] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:02.182629] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0A4] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:02.182665] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0A4] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:02.182675] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0A4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:02.182703] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0A4] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:02.182810] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0A4] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:02.182822] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0A4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:02.186008] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0BC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:02.207782] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A3] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:02.207856] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A3] [lt=70] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:02.207868] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:02.207886] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A3] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=174, ddl_arg=NULL) [2024-01-03 18:08:02.252629] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E072] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:02.252672] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E072] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:02.252689] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E072] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:02.252729] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E072] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:02.287634] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E08B] [lt=4] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:02.616224] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:02.616271] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB8] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:02.616288] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB8] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:02.616347] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB8] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=167, ddl_arg=NULL) [2024-01-03 18:08:02.703288] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:02.703318] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:02.703329] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:02.741843] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E67] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:02.742605] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E68] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:02.743477] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E69] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:02.744041] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E6A] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:02.744583] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E6B] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:02.745044] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E6C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:08:02.745519] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E6D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:02.768106] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:02.768164] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276482207718, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-958, last_round_trip_time:806, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:02.768233] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=57] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:02.768317] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:02.768405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276481510326, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-682, last_round_trip_time:889, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:02.768433] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:03.138608] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=29] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:03.138673] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:03.138690] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:03.139685] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E187] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.140210] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E188] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.140662] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E189] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.141187] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF0-00060E079A34E18A] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.183002] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E08D] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:03.214323] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E08D] [lt=56] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:03.214361] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E08D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:03.214372] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E08D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:03.214397] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E08D] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:03.214493] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E08D] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:03.214507] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E08D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:03.217686] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0A7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:03.250709] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0A7] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:03.250753] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0A7] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:03.250767] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0A7] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:03.250802] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0A7] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:03.250938] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0A7] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:03.250977] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0A7] [lt=31] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:03.253094] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E075] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:03.287680] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E075] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:03.287716] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E075] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:03.287726] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E075] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:03.287750] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E075] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:03.287868] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E075] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:03.287887] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E075] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:03.382510] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D89] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.383228] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D8A] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:08:03.384061] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D8B] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.384701] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D8C] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:03.385241] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D8D] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.385768] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D8E] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:03.386301] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D8F] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:03.511571] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428514] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:03.511638] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428514] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:03.511651] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428514] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:03.511669] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428514] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=138, ddl_arg=NULL) [2024-01-03 18:08:03.705928] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:03.705990] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=56] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:03.706000] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:03.770791] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:03.770842] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276482207718, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-958, last_round_trip_time:806, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:03.770872] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:03.770892] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:03.770967] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276483511536, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:900, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:03.770999] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:04.208768] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A4] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:04.208807] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A4] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:04.208825] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A4] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:04.208849] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A4] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:08:04.214712] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E076] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:04.246821] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E076] [lt=63] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:04.246859] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E076] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:04.246869] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E076] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:04.246893] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E076] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:04.247045] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E076] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:04.247058] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E076] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:04.251136] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0C1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:04.282172] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0C1] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:04.282199] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0C1] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:04.282209] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0C1] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:04.282232] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0C1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:04.282318] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0C1] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:04.282338] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0C1] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:04.288158] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E090] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:04.317850] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E090] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:04.317885] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E090] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:04.317900] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E090] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:04.317923] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E090] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:04.318043] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E090] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:04.318056] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E090] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:04.347593] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428461] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:04.617196] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBB9] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:04.617232] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBB9] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:04.617242] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBB9] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:04.617258] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBB9] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:08:04.708321] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:04.708350] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:04.708359] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:04.746363] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E6E] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:04.747000] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E6F] [lt=81] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:08:04.747661] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E70] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:04.748246] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E71] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:04.748835] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E72] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:04.749466] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E73] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:04.750039] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E74] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:04.773483] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=43] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:04.773568] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276484208737, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1064, last_round_trip_time:817, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:04.773582] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:04.773869] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:04.773937] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276483511536, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:900, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:04.773988] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=47] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:04.986117] INFO [RS] ob_rs_rpc_processor.h:196 [2013][474][YB42C0A86EF0-00060E079A24DB0D] [lt=54] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:05.142117] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E18B] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.142766] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E18C] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.143242] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E18D] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.143634] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E18E] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.247216] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E091] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:05.279143] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E091] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:05.279182] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E091] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:05.279192] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E091] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:05.279216] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E091] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:05.279319] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E091] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:05.279333] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E091] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:05.282481] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0AC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:05.312629] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0AC] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:05.312663] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0AC] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:05.312673] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0AC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:05.312695] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0AC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:05.312791] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0AC] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:05.312803] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0AC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:05.318209] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E079] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:05.348234] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E079] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:05.348282] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E079] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:05.348303] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E079] [lt=18] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:05.348327] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E079] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:05.348455] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E079] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:05.348468] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E079] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:05.387171] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D90] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.387785] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D91] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:05.388368] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D92] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.388846] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D93] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:05.389398] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D94] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.389929] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D95] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:05.390451] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D96] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:05.512610] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428515] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:05.512649] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428515] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:05.512660] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428515] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:05.512676] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428515] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:08:05.711636] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:05.711674] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:05.711684] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:05.711705] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:05.711719] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:05.711781] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:05.712630] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:05.712826] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:05.713517] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E7] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:08:05.713703] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:05.713711] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:05.713876] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:05.714770] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:05.714776] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:05.714966] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:05.714990] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:05.714998] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:05.715062] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=8] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:05.715070] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:08:05.716383] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:05.716437] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:05.716453] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=14] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:05.718987] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=13] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:05.720475] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:05.776361] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:05.776383] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:05.776409] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276484208737, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1064, last_round_trip_time:817, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:05.776422] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:05.776424] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276485512579, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-771, last_round_trip_time:880, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:05.776436] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:05.952549] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:05.952567] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=14] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:06.148855] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:06.148866] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:06.148877] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=164) [2024-01-03 18:08:06.148886] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:06.148894] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:06.148902] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=676330514) [2024-01-03 18:08:06.148932] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:06.148941] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E0C7] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:06.209749] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A5] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:06.209788] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A5] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:06.209798] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A5] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:06.209814] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A5] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=95, ddl_arg=NULL) [2024-01-03 18:08:06.279443] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E07A] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:06.310733] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E07A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:06.310750] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E07A] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:06.310760] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E07A] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:06.310798] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E07A] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:06.310920] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E07A] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:06.310933] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E07A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:06.310983] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E07B] [lt=25] [dc=0] start to process rs list update task [2024-01-03 18:08:06.311094] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E07B] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:06.312930] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E094] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:06.343222] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E094] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:06.343272] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E094] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:06.343291] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E094] [lt=17] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:06.343321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E094] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:06.343464] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E094] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:06.343485] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E094] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:06.348667] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0AF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:06.378539] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0AF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:06.378578] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0AF] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:06.378588] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0AF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:06.378612] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0AF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:06.378711] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0AF] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:06.378724] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0AF] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:06.618137] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:06.618174] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBA] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:06.618185] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:06.618202] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=124, ddl_arg=NULL) [2024-01-03 18:08:06.714446] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:06.714494] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=42] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:06.714504] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:06.779074] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:06.779119] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:06.779123] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276485512579, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-771, last_round_trip_time:880, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:06.779136] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:06.779189] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276486209721, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:822, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:06.779216] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:06.880231] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E76] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:06.880796] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E77] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=42, ddl_arg=NULL) [2024-01-03 18:08:06.881361] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E78] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:06.881863] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E79] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:06.882389] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E7A] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:06.882815] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E7B] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:06.883321] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E7C] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.144474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E18F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.145063] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E190] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.145562] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E191] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.146232] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E192] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.311110] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0B0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:07.343498] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0B0] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:07.343542] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0B0] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:07.343556] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0B0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:07.343589] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0B0] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:07.343664] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0CA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:07.343705] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0B0] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:07.343722] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0B0] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:07.374227] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0CA] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:07.374262] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0CA] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:07.374271] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0CA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:07.374295] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0CA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:07.374385] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0CA] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:07.374398] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0CA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:07.378930] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E097] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:07.411518] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E097] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:07.411541] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E097] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:07.411551] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E097] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:07.411576] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E097] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:07.411691] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E097] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:07.411714] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E097] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:07.510600] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF2-00060E079EC94D98] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.511280] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D99] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:07.511848] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D9A] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.512350] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D9B] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:07.512892] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D9C] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.513380] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94D9D] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:07.513635] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428516] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:07.513658] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428516] [lt=20] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:07.513669] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428516] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:07.513684] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428516] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:08:07.513811] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D9E] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:07.717753] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:07.717783] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:07.717792] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:07.781419] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:07.781469] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276487513585, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-780, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:07.781499] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:07.781847] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:07.781890] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276486209721, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:822, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:07.781915] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:08.140153] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:08.140217] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:08.140251] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=23] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:08.210842] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:08.210896] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A6] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:08.210911] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A6] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:08.210928] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A6] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=117, ddl_arg=NULL) [2024-01-03 18:08:08.343937] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E098] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:08.378522] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E098] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:08.378557] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E098] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:08.378567] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E098] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:08.378592] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E098] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:08.378676] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E080] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:08.378731] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E098] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:08.378754] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E098] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:08.410872] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E080] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:08.410913] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E080] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:08.410923] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E080] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:08.410967] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E080] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:08.411066] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E080] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:08.411081] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E080] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:08.411894] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0B3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:08.443214] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0B3] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:08.443251] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0B3] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:08.443261] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0B3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:08.443286] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0B3] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:08.443397] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0B3] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:08.443418] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0B3] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:08.619027] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBB] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:08.619079] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBB] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:08.619095] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBB] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:08.619122] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:08:08.720350] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:08.720368] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:08.720377] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:08.784537] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:08.784590] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276487513585, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-780, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:08.784602] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:08.784854] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:08.784897] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276488210813, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-986, last_round_trip_time:825, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:08.784911] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:08.884209] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF1-00060E079C528E7D] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:08.884925] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E7E] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=27, ddl_arg=NULL) [2024-01-03 18:08:08.885681] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2014][476][YB42C0A86EF1-00060E079C528E7F] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:08.886314] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E80] [lt=62] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:08.886876] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E81] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:08.887389] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E82] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:08.887902] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E83] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.147266] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E194] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.147891] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E195] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.148414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E196] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.148834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E197] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.348419] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428462] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:09.378909] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0B4] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:09.408889] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0B4] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:09.408912] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0B4] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:09.408921] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0B4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:09.408965] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0B4] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:09.409151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0B4] [lt=64] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:09.409181] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0B4] [lt=18] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:09.411257] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0CF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:09.450331] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0CF] [lt=50] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:09.450374] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0CF] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:09.450388] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0CF] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:09.450424] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0CF] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:09.450505] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E09B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:09.450716] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0CF] [lt=148] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:09.450738] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0CF] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:09.482471] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E09B] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:09.482510] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E09B] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:09.482520] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E09B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:09.482546] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E09B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:09.482647] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E09B] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:09.482661] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E09B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:09.482689] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=12] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:09.482709] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:09.482782] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:09.483579] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=30] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:09.483786] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:09.484875] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:09.484883] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:09.485206] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:09.486176] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:09.486184] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:09.486370] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:09.486393] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:09.486402] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:09.486485] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:09.486493] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:08:09.487868] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:09.487933] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=46] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:09.487965] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:09.491098] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=12] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:09.492549] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:09.514587] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428517] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:09.514630] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428517] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:09.514641] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428517] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:09.514637] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94D9F] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.514657] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428517] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=112, ddl_arg=NULL) [2024-01-03 18:08:09.515397] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DA0] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:08:09.516111] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DA1] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.516843] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DA2] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:09.517332] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2020][488][YB42C0A86EF2-00060E079EC94DA3] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.517966] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DA4] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:09.518571] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DA5] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:09.723292] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:09.723330] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:09.723341] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:09.726294] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:09.726310] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:09.917188] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:09.917198] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:09.917209] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=165) [2024-01-03 18:08:09.917217] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:09.917224] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:09.917232] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=680098845) [2024-01-03 18:08:09.917256] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:09.917275] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E09D] [lt=17] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:09.917303] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E09E] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:09.917425] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E09E] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:09.986775] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB0E] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:10.211925] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A7] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:10.211989] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A7] [lt=59] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:10.212002] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A7] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:10.212019] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A7] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:08:10.409433] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E085] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:10.440684] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E085] [lt=61] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:10.440730] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E085] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:10.440741] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E085] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:10.440764] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E085] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:10.440870] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E085] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:10.440884] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E085] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:10.450919] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0D2] [lt=37] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:10.488445] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0D2] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:10.488484] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0D2] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:10.488494] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0D2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:10.488518] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0D2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:10.488582] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0B7] [lt=40] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:10.488624] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0D2] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:10.488637] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0D2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:10.517815] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0B7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:10.517851] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0B7] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:10.517863] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0B7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:10.517887] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0B7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:10.518033] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0B7] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:10.518046] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0B7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:10.619995] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:10.620034] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBC] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:10.620046] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:10.620064] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=142, ddl_arg=NULL) [2024-01-03 18:08:10.714380] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E8] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:10.725811] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:10.725840] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:10.725850] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:10.789103] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:10.789151] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:10.789156] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276490211880, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1108, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:10.789168] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:10.789194] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276489514547, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-827, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:10.789206] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:10.888912] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E84] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:10.889681] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E85] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:10.890304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E86] [lt=103] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:10.890837] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E87] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:10.891368] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E88] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:10.891870] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E89] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:10.892378] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E8A] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.149658] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E198] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.150108] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E199] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.150519] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E19A] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.150926] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E19B] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.441063] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0B8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:11.473361] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0B8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:11.473397] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0B8] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:11.473407] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0B8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:11.473430] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0B8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:11.473526] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0B8] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:11.473539] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0B8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:11.488787] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0A1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:11.515563] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428518] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:11.515604] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428518] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:11.515616] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428518] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:11.515633] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428518] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:08:11.519000] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0A1] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:11.519039] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0A1] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:11.519049] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0A1] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:11.519072] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0A1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:11.519150] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E088] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:11.519206] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0A1] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:11.519220] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0A1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:11.519560] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DA6] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.520454] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF2-00060E079EC94DA7] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:11.521209] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF2-00060E079EC94DA8] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.521864] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DA9] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:11.522581] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DAA] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.523205] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DAB] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:11.523806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DAC] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:11.549772] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E088] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:11.549810] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E088] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:11.549820] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E088] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:11.549844] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E088] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:11.549964] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E088] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:11.549986] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E088] [lt=15] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:11.728761] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:11.728807] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=38] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:11.728823] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:11.791761] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:11.791814] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276491515530, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-785, last_round_trip_time:864, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:11.791827] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:11.791987] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=47] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:11.792034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276490211880, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1108, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:11.792047] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:12.213298] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:12.213338] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A8] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:12.213350] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A8] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:12.213366] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:08:12.473699] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E089] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:12.505269] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E089] [lt=35] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:12.505293] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E089] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:12.505307] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E089] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:12.505330] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E089] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:12.505463] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E089] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:12.505476] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E089] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:12.519358] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0D7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:12.551993] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0D7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:12.552028] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0D7] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:12.552038] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0D7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:12.552061] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0D7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:12.552122] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0A4] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:12.552166] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0D7] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:12.552179] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0D7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:12.582448] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0A4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:12.582495] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0A4] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:12.582506] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0A4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:12.582529] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0A4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:12.582623] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0A4] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:12.582636] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0A4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:12.620990] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBD] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:12.621044] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBD] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:12.621060] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBD] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:12.621086] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBD] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=184, ddl_arg=NULL) [2024-01-03 18:08:12.731480] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:12.731512] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:12.731521] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:12.794051] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:12.794101] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276491515530, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-785, last_round_trip_time:864, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:12.794113] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:12.794291] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:12.794334] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276492213265, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-904, last_round_trip_time:839, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:12.794359] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:12.893370] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E8C] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:12.894235] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E8D] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:12.895027] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E8E] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:12.895650] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E8F] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:12.897098] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E90] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:12.897742] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E91] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:08:12.898253] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E92] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.299703] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=47] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:13.299756] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:13.299803] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=36] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:13.300975] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E19D] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.301480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E19E] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.301901] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E19F] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.302318] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A0] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.505652] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0A5] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:13.516567] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428519] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:13.516606] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428519] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:13.516617] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428519] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:13.516634] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428519] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:08:13.525004] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DAE] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.525653] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DAF] [lt=18] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:13.526219] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DB0] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.526770] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DB1] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:13.527251] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DB2] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.527736] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DB3] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:13.528290] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DB4] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:13.536692] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0A5] [lt=19] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:13.536726] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0A5] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:13.536736] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0A5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:13.536759] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0A5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:13.536859] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0A5] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:13.536872] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0A5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:13.552332] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0BD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:13.584318] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0BD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:13.584340] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0BD] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:13.584354] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0BD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:13.584387] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0BD] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:13.584470] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E08C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:13.584557] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0BD] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:13.584575] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0BD] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:13.613681] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E08C] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:13.613710] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E08C] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:13.613719] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E08C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:13.613742] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E08C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:13.613841] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E08C] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:13.613855] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E08C] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:13.613876] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:13.613893] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:13.613936] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:13.614709] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=15] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:13.615055] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:13.616085] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:13.616095] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:13.616275] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=23] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:13.617177] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:13.617183] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:13.617366] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:13.617388] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:13.617396] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:13.617476] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:13.617487] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=10] [dc=0] broadcast root address succeed [2024-01-03 18:08:13.618897] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:13.618979] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=45] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:13.618991] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:13.621501] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:13.623208] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=53] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:13.734560] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:13.734592] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:13.734601] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:13.796535] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:13.796583] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276493516536, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-712, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:13.796596] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:13.796703] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:13.796749] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276492213265, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-904, last_round_trip_time:839, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:13.796775] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:13.846635] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:13.846646] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:14.045617] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:14.045632] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:14.045644] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=166) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:08:14.045667] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=21] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:14.045675] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:14.045683] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=684227295) [2024-01-03 18:08:14.045711] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:14.045732] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E08E] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:14.045761] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E08F] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:14.045911] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E08F] [lt=19] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:14.214457] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944A9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:14.214505] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944A9] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:14.214521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944A9] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:14.214543] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944A9] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:08:14.349385] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428463] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:14.537004] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0DC] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:14.569680] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0DC] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:14.569717] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0DC] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:14.569727] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0DC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:14.569751] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0DC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:14.569851] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0DC] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:14.569863] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0DC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:14.584768] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0A8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:14.614924] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0A8] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:14.615003] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0A8] [lt=75] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:14.615014] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0A8] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:14.615038] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0A8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:14.615093] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0C0] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:14.615174] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0A8] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:14.615194] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0A8] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:14.622008] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBE] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:14.622063] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBE] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:14.622076] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBE] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:14.622093] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=147, ddl_arg=NULL) [2024-01-03 18:08:14.646087] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0C0] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:14.646135] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0C0] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:14.646149] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0C0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:14.646181] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0C0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:14.646312] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0C0] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:14.646333] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0C0] [lt=16] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:14.737381] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:14.737410] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:14.737420] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:14.799291] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:14.799303] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:14.799341] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276493516536, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-712, last_round_trip_time:841, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:14.799347] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276494214416, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:14.799360] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:14.799363] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:14.899280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E93] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:14.899993] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E94] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:14.900588] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E95] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:14.901140] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E96] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:14.901713] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E97] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:14.902184] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E98] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:14.902649] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E99] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:14.987386] INFO [RS] ob_rs_rpc_processor.h:196 [2022][492][YB42C0A86EF0-00060E079A24DB0F] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:15.303104] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A1] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.303654] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A2] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.304034] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A3] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.304411] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A4] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.517604] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:15.517644] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851A] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:15.517660] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851A] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:15.517677] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=108, ddl_arg=NULL) [2024-01-03 18:08:15.529300] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DB5] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.529985] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DB6] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:15.530802] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF2-00060E079EC94DB7] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.531559] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DB8] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:15.532165] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DB9] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.532740] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DBA] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:15.533253] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DBB] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:15.570024] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0C1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:15.600979] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0C1] [lt=66] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:15.601029] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0C1] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:15.601043] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0C1] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:15.601077] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0C1] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:15.601187] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0C1] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:15.601205] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0C1] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:15.615351] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E092] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:15.645659] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E092] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:15.645692] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E092] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:15.645702] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E092] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:15.645734] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E092] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:15.645856] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E092] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:15.645877] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E092] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:15.646490] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0DF] [lt=66] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:15.674817] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0DF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:15.674852] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0DF] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:15.674862] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0DF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:15.674889] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0DF] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:15.675005] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0DF] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:15.675017] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0DF] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:15.715388] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943E9] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:15.739935] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:15.739984] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:15.739994] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:15.801852] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=53] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:15.801902] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276494214416, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1075, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:15.801915] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:15.801925] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:15.801991] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276495517573, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:15.802004] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:16.215475] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944AA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:16.215518] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944AA] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:16.215529] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944AA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:16.215550] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944AA] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=124, ddl_arg=NULL) [2024-01-03 18:08:16.601432] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0E0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:16.623006] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBBF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:16.623048] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBBF] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:16.623059] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBBF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:16.623081] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBBF] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=111, ddl_arg=NULL) [2024-01-03 18:08:16.634274] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0E0] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:16.634313] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0E0] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:16.634324] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0E0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:16.634348] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0E0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:16.634480] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0E0] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:16.634498] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0E0] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:16.646052] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0AD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:16.675230] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0AD] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:16.675267] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0AD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:16.675277] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0AD] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:16.675299] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0AD] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:16.675364] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E095] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:16.675450] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0AD] [lt=54] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:16.675465] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0AD] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:16.706156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E095] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:16.706193] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E095] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:16.706203] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E095] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:16.706228] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E095] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:16.706332] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E095] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:16.706347] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E095] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:16.742407] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:16.742437] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:16.742447] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:16.804883] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:16.804936] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276496215433, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1107, last_round_trip_time:838, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:16.804968] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:16.805150] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=46] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:16.805197] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276495517573, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:16.805210] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:17.030578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E9B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.031237] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E9C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:17.031824] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E9D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.032328] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528E9E] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:17.032803] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528E9F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.033260] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EA0] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:17.033698] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA1] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.305221] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.305772] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A6] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.306357] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A7] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.306738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1A8] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.518565] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851B] [lt=20] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:17.518612] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851B] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:17.518630] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851B] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:17.518652] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851B] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:08:17.634685] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E096] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:17.666127] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E096] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:17.666162] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E096] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:17.666172] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E096] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:17.666196] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E096] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:17.666296] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E096] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:17.666310] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E096] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:17.675620] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0C6] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:17.677474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DBD] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.678096] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DBE] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:17.678704] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DBF] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.679259] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DC0] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:17.679790] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DC1] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.680275] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DC2] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:17.680719] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DC3] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:17.705388] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0C6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:17.705426] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0C6] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:17.705435] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0C6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:17.705459] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0C6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:17.705564] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0C6] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:17.705577] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0C6] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:17.706509] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0E3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:17.738156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0E3] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:17.738197] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0E3] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:17.738208] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0E3] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:17.738245] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0E3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:17.738380] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0E3] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:17.738393] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0E3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:17.738421] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=11] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:17.738469] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=32] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:17.738559] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=16] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:17.739400] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=18] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:17.739588] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:17.740296] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:17.740304] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:17.740500] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:17.741438] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:17.741445] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:17.741615] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:17.741653] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=35] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:17.741661] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:17.741755] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:17.741790] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=33] [dc=0] broadcast root address succeed [2024-01-03 18:08:17.743174] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:17.743215] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=25] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:17.743226] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:17.745429] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:17.745570] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=86] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:17.745624] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=49] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:17.745634] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:17.746923] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=25] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:17.807253] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:17.807304] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276496215433, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1107, last_round_trip_time:838, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:17.807336] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:17.807710] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:17.807753] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276497518532, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-758, last_round_trip_time:825, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:17.807828] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=70] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:17.987747] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:17.987764] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=13] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:18.216467] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944AB] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:18.216505] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944AB] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:18.216517] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944AB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:18.216573] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944AB] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=137, ddl_arg=NULL) [2024-01-03 18:08:18.225744] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=29] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:18.225760] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:18.225778] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=11] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=167) [2024-01-03 18:08:18.225789] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=10] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:18.225800] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=8] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:18.225828] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=24] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=688407438) [2024-01-03 18:08:18.225864] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=10] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:18.225885] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E0E5] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:18.225931] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E0E6] [lt=13] [dc=0] start to process rs list update task [2024-01-03 18:08:18.226152] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E0E6] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:18.301259] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:18.301350] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=19] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:18.301377] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=13] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:18.623835] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC0] [lt=34] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:18.623875] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC0] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:18.623889] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC0] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:18.623915] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC0] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:08:18.666453] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0B2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:18.697859] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0B2] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:18.697897] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0B2] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:18.697907] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0B2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:18.697931] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0B2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:18.698062] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0B2] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:18.698076] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0B2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:18.705747] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E099] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:18.736470] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E099] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:18.736506] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E099] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:18.736516] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E099] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:18.736540] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E099] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:18.736632] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E099] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:18.736649] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E099] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:18.738552] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0C9] [lt=19] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:18.748577] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:18.748609] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:18.748619] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:18.769380] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0C9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:18.769417] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0C9] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:18.769433] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0C9] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:18.769457] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0C9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:18.769592] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0C9] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:18.769606] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0C9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:18.809985] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:18.810037] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276498216437, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1069, last_round_trip_time:832, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:18.810106] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=64] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:18.810658] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:18.810700] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276497518532, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-758, last_round_trip_time:825, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:18.810726] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:19.034628] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA2] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.035325] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EA3] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=26, ddl_arg=NULL) [2024-01-03 18:08:19.036076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA4] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.036619] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EA5] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:19.037211] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA6] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.037772] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EA7] [lt=130] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:19.038259] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.307546] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1AA] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.308146] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF0-00060E079A34E1AB] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.308825] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1AC] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.309353] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1AD] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.350227] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428464] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:19.519750] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851C] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:19.519800] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851C] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:19.519815] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851C] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:19.519833] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:08:19.681578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DC4] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.682403] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DC5] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:19.683852] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DC6] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.684609] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DC7] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:19.685121] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DC8] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.685716] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DC9] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:19.686366] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DCA] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:19.698238] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0E9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:19.728707] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0E9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:19.728741] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0E9] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:19.728750] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0E9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:19.728774] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0E9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:19.728871] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0E9] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:19.728886] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0E9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:19.736834] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0CA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:19.751793] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:19.751829] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:19.751846] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:19.768698] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0CA] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:19.768738] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0CA] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:19.768751] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0CA] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:19.768775] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0CA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:19.768884] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0CA] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:19.768903] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0CA] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:19.769752] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E09C] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:19.799279] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E09C] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:19.799331] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E09C] [lt=47] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:19.799345] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E09C] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:19.799379] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E09C] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:19.799540] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E09C] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:19.799562] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E09C] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:19.812892] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:19.812974] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276498216437, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1069, last_round_trip_time:832, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:19.812995] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:19.813488] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:19.813530] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276499519710, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:19.813542] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:19.988094] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB10] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:20.217587] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944AC] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:20.217619] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944AC] [lt=29] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:20.217628] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944AC] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:20.217644] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944AC] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=88, ddl_arg=NULL) [2024-01-03 18:08:20.624659] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC1] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:20.624699] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC1] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:20.624711] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:20.624751] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:08:20.716342] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943EA] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:20.729024] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0CB] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:20.754896] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:20.754925] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:20.754935] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:20.761712] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0CB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:20.761751] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0CB] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:20.761760] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0CB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:20.761789] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0CB] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:20.761883] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0CB] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:20.761895] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0CB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:20.769068] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0EC] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:20.799977] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0EC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:20.800019] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0EC] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:20.800033] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0EC] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:20.800064] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0EC] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:20.800120] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0B9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:20.800208] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0EC] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:20.800225] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0EC] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:20.815863] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:20.815913] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276500217560, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1088, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:20.815939] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:20.816342] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:20.816384] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276499519710, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:20.816410] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:20.832662] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0B9] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:20.832712] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0B9] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:20.832726] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0B9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:20.832749] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0B9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:20.832901] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0B9] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:20.832921] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0B9] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:21.039057] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EA9] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.039932] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EAA] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:21.040647] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EAB] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.041235] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EAC] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:21.041834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EAD] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.042413] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EAE] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:21.042899] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EAF] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.310118] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1AE] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.310543] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1AF] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.310968] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B0] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.311375] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B1] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.520924] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851D] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:21.520997] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851D] [lt=69] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:21.521010] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851D] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:21.521026] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=135, ddl_arg=NULL) [2024-01-03 18:08:21.687288] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DCB] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.687929] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DCC] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:21.688616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DCD] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.689109] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DCE] [lt=79] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:21.689665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DCF] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.690130] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DD0] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:21.690619] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DD1] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:21.759400] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:21.759433] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:21.759443] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:21.762059] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0A1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:21.792502] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0A1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:21.792541] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0A1] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:21.792554] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0A1] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:21.792589] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0A1] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:21.792702] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0A1] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:21.792715] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0A1] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:21.800393] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0CE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:21.818564] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:21.818615] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276500217560, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1088, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:21.818626] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:21.818647] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:21.818661] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:21.818702] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:21.818847] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:21.818889] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276501520893, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-707, last_round_trip_time:819, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:21.818901] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:21.819392] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:21.819590] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:21.820576] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=61] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:21.820586] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:21.820791] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=26] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:21.821694] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:21.821701] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:21.821914] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:21.821937] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:21.821960] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:08:21.822043] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:21.822058] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:08:21.823582] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:21.823690] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=47] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:21.823730] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=36] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:21.826314] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=10] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:21.827889] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=53] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:21.829850] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0CE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:21.829884] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0CE] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:21.829893] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0CE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:21.829916] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0CE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:21.830033] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0CE] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:21.830045] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0CE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:21.833074] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0A2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:21.865617] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0A2] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:21.865656] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0A2] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:21.865667] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0A2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:21.865691] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0A2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:21.865815] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0A2] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:21.865836] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0A2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:22.076157] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:22.076167] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:22.218719] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944AD] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:22.218742] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944AD] [lt=20] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:22.218753] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944AD] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:22.218768] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944AD] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=82, ddl_arg=NULL) [2024-01-03 18:08:22.295932] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:22.295939] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=4] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:22.295963] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=168) [2024-01-03 18:08:22.295969] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:22.295974] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:22.295980] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=692477593) [2024-01-03 18:08:22.296000] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E0BD] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:22.625595] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:22.625630] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC2] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:22.625640] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC2] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:22.625659] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC2] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=94, ddl_arg=NULL) [2024-01-03 18:08:22.761866] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:22.761905] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:22.761920] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:22.761982] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E0F3] [lt=10] [dc=0] start to process rs list update task [2024-01-03 18:08:22.762145] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E0F3] [lt=15] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:22.792904] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0CF] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:22.821178] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=66] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:22.821228] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276502218689, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1132, last_round_trip_time:847, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:22.821241] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:22.821386] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:22.821428] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276501520893, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-707, last_round_trip_time:819, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:22.821455] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:22.824520] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0CF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:22.824558] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0CF] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:22.824567] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0CF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:22.824590] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0CF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:22.824719] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0CF] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:22.824731] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0CF] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:22.830216] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0F4] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:22.861387] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0F4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:22.861422] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0F4] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:22.861432] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0F4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:22.861455] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0F4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:22.861544] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0F4] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:22.861578] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0F4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:22.866000] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0A5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:22.895283] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0A5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:22.895347] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0A5] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:22.895359] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0A5] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:22.895383] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0A5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:22.895485] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0A5] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:22.895514] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0A5] [lt=22] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:23.043836] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EB1] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.044636] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EB2] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:23.045321] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EB3] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.045926] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EB4] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:23.046608] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EB5] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.047177] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EB6] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:23.047692] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EB7] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.454783] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=52] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:23.454850] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=46] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:23.454867] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:23.455900] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B3] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.456380] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B4] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.456785] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B5] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.457110] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B6] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.521927] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:23.521981] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851E] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:23.521993] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:23.522009] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851E] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=115, ddl_arg=NULL) [2024-01-03 18:08:23.691449] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DD3] [lt=8] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.692215] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DD4] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:08:23.692850] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DD5] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.693378] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DD6] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:23.693872] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DD7] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.694401] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DD8] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:23.694904] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DD9] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:23.764767] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:23.764796] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:23.764805] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:23.823684] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:23.823733] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276502218689, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1132, last_round_trip_time:847, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:23.823745] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:23.824214] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:23.824256] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276503521897, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:793, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:23.824283] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:23.824887] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0A6] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:23.855983] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0A6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:23.856017] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0A6] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:23.856038] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0A6] [lt=20] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:23.856062] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0A6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:23.856178] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0A6] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:23.856198] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0A6] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:23.861726] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0C2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:23.891800] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0C2] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:23.891835] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0C2] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:23.891844] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0C2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:23.891867] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0C2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:23.892016] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0C2] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:23.892035] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0C2] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:23.895650] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0D2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:23.925524] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0D2] [lt=25] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:23.925558] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0D2] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:23.925572] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0D2] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:23.925595] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0D2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:23.925721] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0D2] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:23.925741] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0D2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:24.219680] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944AE] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:24.219727] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944AE] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:24.219745] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944AE] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:24.219766] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944AE] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=122, ddl_arg=NULL) [2024-01-03 18:08:24.351142] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428465] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:24.626541] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC3] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:24.626605] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC3] [lt=60] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:24.626618] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC3] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:24.626636] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=135, ddl_arg=NULL) [2024-01-03 18:08:24.767332] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:24.767368] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:24.767378] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:24.826432] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:24.826483] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276504219649, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1129, last_round_trip_time:833, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:24.826496] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:24.826671] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:24.826756] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276503521897, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:793, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:24.826784] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:24.856390] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0D3] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:24.886443] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0D3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:24.886477] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0D3] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:24.886487] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0D3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:24.886511] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0D3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:24.886597] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0D3] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:24.886610] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0D3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:24.892219] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0F9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:24.922399] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0F9] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:24.922433] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0F9] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:24.922442] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0F9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:24.922467] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0F9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:24.922569] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0F9] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:24.922583] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0F9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:24.925912] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0A9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:24.956864] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0A9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:24.956892] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0A9] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:24.956901] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0A9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:24.956934] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0A9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:24.957088] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0A9] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:24.957108] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0A9] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:24.988730] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB11] [lt=77] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:25.048584] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EB8] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.049288] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EB9] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:25.049982] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EBA] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.050657] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EBB] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:08:25.051280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EBC] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.051775] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EBD] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:25.052248] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EBE] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.457893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.458438] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B8] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.458843] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1B9] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.459470] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1BA] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.522909] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42851F] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:25.522972] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42851F] [lt=58] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:25.522984] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42851F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:25.523001] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42851F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=146, ddl_arg=NULL) [2024-01-03 18:08:25.695814] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DDA] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.696620] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DDB] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:08:25.697414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DDC] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.697991] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DDD] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:25.698621] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DDE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.699232] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DDF] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:25.699706] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE0] [lt=121] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:25.717429] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943EB] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:25.770046] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:25.770077] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:25.770087] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:25.829221] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:25.829276] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276504219649, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1129, last_round_trip_time:833, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:25.829298] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:25.829375] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:25.829417] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276505522858, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-664, last_round_trip_time:775, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:25.829449] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:25.829470] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:25.829483] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:25.829542] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:25.830388] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:25.830587] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:25.831390] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=34] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:25.831404] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:25.831616] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:25.832589] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:25.832596] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:25.832768] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:25.832777] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:25.832787] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:25.832886] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:25.832894] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:08:25.834408] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:25.834455] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=24] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:25.834467] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:25.836993] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:25.838557] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=47] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:25.886756] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0AA] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:25.917709] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0AA] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:25.917752] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0AA] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:25.917763] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0AA] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:25.917791] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0AA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:25.917942] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0AA] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:25.917978] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0AA] [lt=28] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:25.922732] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0C7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:25.954609] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0C7] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:25.954659] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0C7] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:25.954674] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0C7] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:25.954706] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0C7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:25.954852] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0C7] [lt=46] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:25.954905] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0C7] [lt=40] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:25.957318] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0D6] [lt=53] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:25.987699] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0D6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:25.987738] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0D6] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:25.987748] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0D6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:25.987772] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0D6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:25.987879] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0D6] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:25.987892] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0D6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:26.066904] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:26.066915] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:26.281288] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:26.281302] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:26.281314] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=169) [2024-01-03 18:08:26.281322] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:26.281329] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:26.281337] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=696462949) [2024-01-03 18:08:26.281364] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:26.281371] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E0FD] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:26.281399] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E0FE] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:26.281522] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E0FE] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:26.627581] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC4] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:26.627619] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC4] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:26.627630] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:26.627648] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:08:26.772999] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:26.773013] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:26.773023] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:26.832091] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:26.832096] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:26.832143] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276505522858, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-664, last_round_trip_time:775, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:26.832157] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276506220635, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1136, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:26.832173] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:26.832176] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:26.918152] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E0FF] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:26.950797] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E0FF] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:26.950837] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E0FF] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:26.950848] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E0FF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:26.950871] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E0FF] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:26.950994] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E0FF] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:26.951009] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E0FF] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:26.955079] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0AD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:26.985938] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0AD] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:26.986013] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0AD] [lt=72] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:26.986023] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0AD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:26.986059] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0AD] [lt=18] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:26.986164] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0AD] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:26.986178] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0AD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:26.988054] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0D9] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:27.018698] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0D9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:27.018735] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0D9] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:27.018745] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0D9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:27.018770] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0D9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:27.018902] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0D9] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:27.018916] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0D9] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:27.181204] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC0] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.181918] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EC1] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:27.182629] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC2] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.183254] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EC3] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:27.183738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC4] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.184180] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EC5] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:27.184710] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC6] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.460530] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1BB] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.461000] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1BC] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.461388] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1BD] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.461808] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1BE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.523862] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428520] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:27.523910] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428520] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:27.523923] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428520] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:27.523940] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428520] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:08:27.775351] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:27.775381] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:27.775391] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:27.834815] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:27.834904] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:27.834868] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276507523825, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-705, last_round_trip_time:774, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:27.834969] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=96] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:27.834988] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276506220635, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1136, last_round_trip_time:828, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:27.835000] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:27.840990] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE2] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.841711] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF2-00060E079EC94DE3] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:27.842427] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE4] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.843012] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DE5] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:08:27.843738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE6] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.844272] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DE7] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:27.844878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE8] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:27.951167] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0DA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:27.982940] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0DA] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:27.982985] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0DA] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:27.983000] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0DA] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:27.983031] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0DA] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:27.983151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0DA] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:27.983164] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0DA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:27.986322] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0CC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:28.016048] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0CC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:28.016082] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0CC] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:28.016096] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0CC] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:28.016134] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0CC] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:28.016264] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0CC] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:28.016281] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0CC] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:28.019076] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E102] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:28.049638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E102] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:28.049676] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E102] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:28.049686] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E102] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:28.049709] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E102] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:28.049811] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E102] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:28.049826] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E102] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:28.221576] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B0] [lt=36] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:28.221619] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B0] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:28.221630] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:28.221648] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:08:28.456352] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:28.456413] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:28.456430] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:28.628578] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC5] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:28.628615] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC5] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:28.628628] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC5] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:28.628703] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC5] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=169, ddl_arg=NULL) [2024-01-03 18:08:28.777765] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:28.777778] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:28.777787] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:28.837342] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:28.837393] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276507523825, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-705, last_round_trip_time:774, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:28.837405] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:28.837591] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:28.837658] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276508221544, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1141, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:28.837688] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:28.983336] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E103] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:29.017377] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E103] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:29.017413] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E103] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:29.017423] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E103] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:29.017447] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E103] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:29.017501] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0B2] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:29.017541] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E103] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:29.017557] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E103] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:29.045798] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0B2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:29.045834] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0B2] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:29.045844] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0B2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:29.045866] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0B2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:29.045982] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0B2] [lt=46] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:29.045996] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0B2] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:29.049983] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0DD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:29.077441] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0DD] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:29.077478] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0DD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:29.077487] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0DD] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:29.077510] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0DD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:29.077611] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0DD] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:29.077623] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0DD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:29.185646] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC7] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.186365] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EC8] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:29.187094] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EC9] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.187671] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ECA] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:29.188239] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ECB] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.188731] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ECC] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:29.189202] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ECD] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.352000] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428466] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:29.462609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C0] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.463247] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C1] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.463674] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C2] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.464154] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C3] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.524916] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428521] [lt=23] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:29.525003] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428521] [lt=83] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:29.525016] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428521] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:29.525058] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428521] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=178, ddl_arg=NULL) [2024-01-03 18:08:29.781263] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:29.781303] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:29.781317] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:29.840502] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:29.840550] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276508221544, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1141, last_round_trip_time:816, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:29.840562] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:29.840731] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:29.840773] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276509524884, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-709, last_round_trip_time:780, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:29.840789] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:29.840808] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:29.840821] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:29.840864] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=11] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:29.841493] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:29.841686] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:29.842573] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=30] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:29.842581] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:29.842869] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:29.843877] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:29.843884] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:29.844089] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:29.844099] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=7] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:29.844111] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:08:29.844190] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:29.844205] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:08:29.845416] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:29.845475] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:29.845500] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:29.845896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DE9] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.846546] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DEA] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:29.847231] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DEB] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.847663] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:29.847750] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DEC] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:29.848296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94DED] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.849017] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DEE] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:29.849272] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:29.849609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DEF] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:29.989385] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB12] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:30.017722] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0DE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:30.026428] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=14] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:08:30.049386] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0DE] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:30.049423] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0DE] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:30.049432] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0DE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:30.049455] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0DE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:30.049511] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0D1] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:30.049554] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0DE] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:30.049566] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0DE] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:30.064430] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=29] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:30.064463] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=27] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:30.081294] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0D1] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:30.081335] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0D1] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:30.081349] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0D1] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:30.081372] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0D1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:30.081429] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0B5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:30.081511] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0D1] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:30.081525] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0D1] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:30.112205] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0B5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:30.112246] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0B5] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:30.112260] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0B5] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:30.112296] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0B5] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:30.112405] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0B5] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:30.112431] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0B5] [lt=18] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:30.288392] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:30.288402] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:30.288414] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=170) [2024-01-03 18:08:30.288423] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:30.288430] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:30.288438] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=700470051) [2024-01-03 18:08:30.288467] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:30.288488] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E107] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:30.288517] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E108] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:30.288658] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E108] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:30.629499] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:30.629519] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC6] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:30.629529] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC6] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:30.629545] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=79, ddl_arg=NULL) [2024-01-03 18:08:30.718235] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943EC] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:30.783816] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:30.783837] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:30.783848] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:30.843368] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:30.843417] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276509524884, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-709, last_round_trip_time:780, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:30.843428] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:30.843521] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:30.843558] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276510222702, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1063, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:30.843577] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:31.049706] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E109] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:31.080066] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E109] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:31.080104] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E109] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:31.080114] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E109] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:31.080137] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E109] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:31.080239] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E109] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:31.080252] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E109] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:31.081685] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0E1] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:31.113538] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0E1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:31.113576] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0E1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:31.113585] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0E1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:31.113609] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0E1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:31.113666] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0B8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:31.113710] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0E1] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:31.113722] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0E1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:31.142125] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0B8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:31.142161] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0B8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:31.142171] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0B8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:31.142194] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0B8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:31.142290] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0B8] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:31.142304] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0B8] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:31.190092] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ECE] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.190892] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ECF] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:31.191510] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ED0] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.192220] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ED1] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:31.192826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ED2] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.193370] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ED3] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:31.193972] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ED4] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.465166] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C4] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.465666] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C5] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.466156] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C6] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.466577] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C7] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.526119] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428522] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:31.526156] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428522] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:31.526175] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428522] [lt=17] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:31.526191] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428522] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:08:31.786068] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:31.786098] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:31.786107] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:31.845832] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:31.845885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276510222702, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1063, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:31.845898] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:31.845935] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:31.846012] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276511526091, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-621, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:31.846037] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:31.850448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DF0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.851131] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DF1] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:08:31.851697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DF2] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.852260] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DF3] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:31.852854] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DF4] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:31.853518] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DF5] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:31.853983] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DF6] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:32.080436] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0B9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:32.114176] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0B9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:32.114214] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0B9] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:32.114224] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0B9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:32.114246] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0B9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:32.114308] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0D6] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:32.114350] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0B9] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:32.114363] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0B9] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:32.143547] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0D6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:32.143583] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0D6] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:32.143592] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0D6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:32.143616] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0D6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:32.143699] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0E4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:32.143720] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0D6] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:32.143733] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0D6] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:32.172943] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0E4] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:32.172996] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0E4] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:32.173006] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0E4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:32.173029] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0E4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:32.173133] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0E4] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:32.173153] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0E4] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:32.223653] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:32.223673] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B2] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:32.223684] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B2] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:32.223700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B2] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:08:32.630377] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC7] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:32.630424] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC7] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:32.630440] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC7] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:32.630461] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC7] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=115, ddl_arg=NULL) [2024-01-03 18:08:32.788774] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:32.788803] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:32.788812] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:32.848123] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:32.848190] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276512223623, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1155, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:32.848202] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:32.848416] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:32.848473] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276511526091, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-621, last_round_trip_time:792, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:32.848496] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=19] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:33.114504] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0E5] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:33.145176] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0E5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:33.145236] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0E5] [lt=57] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:33.145246] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0E5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:33.145270] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0E5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:33.145346] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E10E] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:33.145379] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0E5] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:33.145392] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0E5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:33.173517] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E10E] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:33.173554] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E10E] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:33.173564] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E10E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:33.173588] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E10E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:33.173644] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0BC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:33.173695] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E10E] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:33.173709] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E10E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:33.194882] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528ED6] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.195477] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ED7] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:33.196128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF1-00060E079C528ED8] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.196765] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528ED9] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:33.197245] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EDA] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.197736] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EDB] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:33.198200] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EDC] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.202775] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0BC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:33.202813] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0BC] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:33.202824] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0BC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:33.202847] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0BC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:33.202961] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0BC] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:33.202982] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0BC] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:33.527206] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428523] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:33.527244] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428523] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:33.527255] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428523] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:33.527273] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428523] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:08:33.620892] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=29] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:33.621030] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=48] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:33.621075] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=26] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:33.622065] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1C9] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.622560] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CA] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.622997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CB] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.623490] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CC] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.791381] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:33.791413] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:33.791423] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:33.850742] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:33.850794] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276512223623, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1155, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:33.850807] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:33.850855] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:33.850897] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276513527175, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:33.850927] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:33.850966] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:33.850980] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:33.851030] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=14] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:33.851764] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:33.851963] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:33.852745] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:33.852752] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:33.852980] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:33.853913] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:33.853920] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:33.854104] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:33.854114] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:33.854122] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:08:33.854221] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:33.854242] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:08:33.854771] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DF8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.855355] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DF9] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:33.855482] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:33.855541] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=41] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:33.855564] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=21] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:33.855968] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DFA] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.856565] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DFB] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:33.857208] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DFC] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.857718] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94DFD] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:08:33.857754] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:33.858220] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DFE] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:33.859328] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:34.079221] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:34.079231] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:34.145554] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0BD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:34.180259] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0BD] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:34.217871] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0DB] [lt=23] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:34.217907] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0DB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:34.217917] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0DB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:34.217977] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0DB] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:34.218044] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0E8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:34.218093] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0DB] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:34.218106] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0DB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:34.321862] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:34.321875] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:34.321888] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=171) [2024-01-03 18:08:34.321896] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:34.321904] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:34.321912] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=704503525) [2024-01-03 18:08:34.321941] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:34.321983] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E112] [lt=39] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:34.322023] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E113] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:34.322166] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E113] [lt=20] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:34.352837] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428467] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:34.631280] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC8] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:34.631321] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC8] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:34.631333] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC8] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:34.631354] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC8] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:08:34.793903] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:34.793918] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:34.793928] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:34.853302] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:34.853352] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276513527175, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:34.853361] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:34.853365] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:34.853463] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276514224582, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1084, last_round_trip_time:759, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:34.853520] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:34.990137] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB13] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:08:35.180609] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E114] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:35.199024] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EDD] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.199711] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EDE] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:35.200326] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EDF] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.200981] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EE0] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:35.201524] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EE1] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.202197] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EE2] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:35.202718] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EE3] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.212853] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E114] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:35.212892] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E114] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:35.212902] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E114] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:35.212926] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E114] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:35.213057] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E114] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:35.213070] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E114] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:35.218215] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0C0] [lt=26] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:35.248101] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0C0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:35.248142] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0C0] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:35.248152] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0C0] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:35.248176] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0C0] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:35.248293] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0C0] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:35.248306] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0C0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:35.248753] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0EB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:35.279882] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0EB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:35.279916] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0EB] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:35.279930] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0EB] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:35.279973] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0EB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:35.280077] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0EB] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:35.280091] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0EB] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:35.528145] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428524] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:35.528175] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428524] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:35.528186] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428524] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:35.528203] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428524] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=92, ddl_arg=NULL) [2024-01-03 18:08:35.624289] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CD] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.624847] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CE] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.625222] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1CF] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.625687] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF0-00060E079A34E1D0] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.719136] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943ED] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:35.796770] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:35.796803] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:35.796815] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:35.856220] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:35.856263] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:35.856273] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276515528114, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-679, last_round_trip_time:804, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:35.856286] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:35.856305] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276514224582, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1084, last_round_trip_time:759, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:35.856317] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:35.859440] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94DFF] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.860217] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E00] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:35.861091] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E01] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.861693] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E02] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:35.862274] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E03] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:35.862791] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E04] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:35.863377] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E05] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:36.213235] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0EC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:36.225607] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B4] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:36.225647] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B4] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:36.225659] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B4] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:36.225677] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:08:36.246769] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0EC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:36.246814] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0EC] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:36.246829] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0EC] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:36.246865] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0EC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:36.247036] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0EC] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:36.247056] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0EC] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:36.248455] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0E0] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:36.278981] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0E0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:36.279017] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0E0] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:36.279031] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0E0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:36.279054] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0E0] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:36.279150] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0E0] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:36.279162] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0E0] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:36.280229] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E117] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:36.310853] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E117] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:36.310890] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E117] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:36.310904] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E117] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:36.310929] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E117] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:36.311050] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E117] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:36.311063] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E117] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:36.632281] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBC9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:36.632334] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBC9] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:36.632349] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBC9] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:36.632372] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBC9] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:08:36.799831] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:36.799892] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=54] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:36.799902] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:36.858678] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:36.858744] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276515528114, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-679, last_round_trip_time:804, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:36.858787] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:36.858799] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:36.858844] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276516225574, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1163, last_round_trip_time:758, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:36.858901] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=51] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:37.247240] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E118] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:37.281490] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E118] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:37.281537] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E118] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:37.281552] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E118] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:37.281577] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E118] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:37.281639] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0C5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:37.281681] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E118] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:37.281694] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E118] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:37.310666] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0C5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:37.310702] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0C5] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:37.310712] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0C5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:37.310735] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0C5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:37.310831] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0C5] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:37.310845] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0C5] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:37.311199] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0EF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:37.340696] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0EF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:37.340741] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0EF] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:37.340752] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0EF] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:37.340783] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0EF] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:37.340942] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0EF] [lt=46] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:37.340975] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0EF] [lt=24] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:37.341443] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EE5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.342120] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EE6] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:37.342744] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EE7] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.343320] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EE8] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:08:37.343962] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF1-00060E079C528EE9] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.344485] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EEA] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:37.345002] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EEB] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.529062] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428525] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:37.529104] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428525] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:37.529116] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428525] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:37.529133] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428525] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:08:37.626749] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E1D1] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.627356] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D2] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.627826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D3] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.628230] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D4] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.802172] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:37.802202] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:37.802210] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:37.861266] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:37.861317] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276516225574, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1163, last_round_trip_time:758, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:37.861329] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:37.861350] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:37.861366] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:37.861431] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=29] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:37.861434] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:37.861477] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276517529031, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:37.861510] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:37.862075] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:37.862268] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:37.863176] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:37.863183] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:37.863408] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:37.864341] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:37.864346] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=4] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:37.864515] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:37.864536] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:37.864544] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:37.864620] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:37.864628] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:08:37.865847] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:37.865906] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:37.865917] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:37.868135] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=13] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:37.869657] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:37.988883] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E07] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.989583] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E08] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:37.990420] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E09] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.991082] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E0A] [lt=63] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:08:37.991616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E0B] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:37.992093] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E0C] [lt=73] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:37.992591] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E0D] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:38.083033] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:38.083044] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:38.278622] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=3] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:38.278629] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=4] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:38.278638] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=172) [2024-01-03 18:08:38.278645] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:38.278651] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:38.278656] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=708460269) [2024-01-03 18:08:38.278677] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:38.278683] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E0C9] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:38.281841] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0F0] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:38.311774] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0F0] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:38.311808] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0F0] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:38.311817] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0F0] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:38.311840] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0F0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:38.311897] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0E5] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:38.311938] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0F0] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:38.311967] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0F0] [lt=24] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:38.343300] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0E5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:38.343339] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0E5] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:38.343351] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0E5] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:38.343375] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0E5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:38.343485] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0E5] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:38.343498] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0E5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:38.343501] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E11B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:38.374391] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E11B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:38.374428] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E11B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:38.374437] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E11B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:38.374460] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E11B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:38.374577] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E11B] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:38.374593] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E11B] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:38.374644] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E11C] [lt=21] [dc=0] start to process rs list update task [2024-01-03 18:08:38.374800] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E11C] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:38.622598] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:38.622672] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:38.622715] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:38.633157] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:38.633197] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCA] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:38.633213] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCA] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:38.633230] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:08:38.804790] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:38.804819] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:38.804828] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:38.863837] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:38.863876] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:38.863885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276518226615, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1157, last_round_trip_time:767, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:38.863898] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:38.863917] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276517529031, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:38.863934] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:39.312103] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E11D] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:39.343077] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E11D] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:39.343115] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E11D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:39.343131] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E11D] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:39.343166] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E11D] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:39.343285] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E11D] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:39.343298] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E11D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:39.343661] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0CC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:39.345890] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2021][490][YB42C0A86EF1-00060E079C528EEC] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.346616] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EED] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:39.347324] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EEE] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.347910] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EEF] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:39.348626] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF0] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.349214] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EF1] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:39.349730] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF2] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.353877] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428468] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:39.371239] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0CC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:39.371275] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0CC] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:39.371285] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0CC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:39.371308] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0CC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:39.371393] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0CC] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:39.371405] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0CC] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:39.374763] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0F3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:39.404228] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0F3] [lt=23] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:39.404272] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0F3] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:39.404286] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0F3] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:39.404319] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0F3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:39.404479] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0F3] [lt=47] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:39.404497] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0F3] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:39.530014] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428526] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:39.530099] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428526] [lt=75] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:39.530117] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428526] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:39.530145] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428526] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=205, ddl_arg=NULL) [2024-01-03 18:08:39.629003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D6] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.629567] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D7] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.630028] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D8] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.630452] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1D9] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.807242] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:39.807272] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:39.807282] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:39.866078] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:39.866128] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276519529942, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-674, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:39.866140] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:39.866140] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:39.866181] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276518226615, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1157, last_round_trip_time:767, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:39.866201] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:39.990877] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB14] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:39.993446] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E0E] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.994027] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E0F] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:39.994525] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E10] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.995030] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E11] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:39.995627] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E12] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:39.996129] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E13] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:39.996553] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E14] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:40.227700] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B6] [lt=53] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:40.227739] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B6] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:40.227751] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:40.227767] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:08:40.343440] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0F4] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:40.370780] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0F4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:40.370812] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0F4] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:40.370821] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0F4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:40.370844] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0F4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:40.370937] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0F4] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:40.370966] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0F4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:40.371543] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0EA] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:40.397288] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0EA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:40.397321] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0EA] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:40.397334] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0EA] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:40.397356] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0EA] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:40.397450] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0EA] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:40.397462] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0EA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:40.404639] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0CF] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:40.423264] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0CF] [lt=4] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:40.423283] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0CF] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:40.423288] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0CF] [lt=4] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:40.423306] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0CF] [lt=4] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:40.423368] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0CF] [lt=6] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:40.423376] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0CF] [lt=3] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:40.634012] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCB] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:40.634049] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCB] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:40.634059] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCB] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:40.634075] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCB] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=93, ddl_arg=NULL) [2024-01-03 18:08:40.719894] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943EE] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:40.809883] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:40.809914] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:40.809924] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:40.868421] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:40.868454] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:40.868488] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276519529942, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-674, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:40.868500] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:40.868508] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276520227670, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1268, last_round_trip_time:772, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:40.868521] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:41.350749] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF3] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.351377] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EF4] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:41.352067] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF5] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.352600] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EF6] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:41.353517] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF7] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.354277] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EF8] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:41.354849] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EF9] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.376919] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0D0] [lt=4] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:41.408221] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0D0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:41.408260] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0D0] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:41.408271] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0D0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:41.408294] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0D0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:41.408350] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E122] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:41.408399] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0D0] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:41.408413] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0D0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:41.440416] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E122] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:41.440466] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E122] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:41.440478] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E122] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:41.440503] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E122] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:41.440580] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0F7] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:41.440654] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E122] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:41.440668] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E122] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:41.473595] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0F7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:41.473632] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0F7] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:41.473649] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0F7] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:41.473686] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0F7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:41.473826] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0F7] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:41.473974] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0F7] [lt=95] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:41.474032] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=10] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:41.474051] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:41.474100] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:41.475010] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:41.475282] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=34] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:41.476202] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:41.476210] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:41.476387] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=25] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:41.477342] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:41.477349] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:41.477530] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:41.477551] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:41.477561] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:08:41.477642] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:41.477666] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=21] [dc=0] broadcast root address succeed [2024-01-03 18:08:41.479238] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=10] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:41.479315] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=51] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:41.479351] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=32] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:41.481852] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:41.483510] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:41.531219] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428527] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:41.531297] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428527] [lt=74] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:41.531310] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428527] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:41.531326] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428527] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=137, ddl_arg=NULL) [2024-01-03 18:08:41.631189] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1DA] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.631722] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1DB] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.632154] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1DC] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.632652] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1DD] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.735858] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:41.735876] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=14] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:41.812457] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:41.812495] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:41.812504] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:41.918530] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:41.918539] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:41.918550] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=173) [2024-01-03 18:08:41.918558] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:41.918565] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:41.918572] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=712100185) [2024-01-03 18:08:41.918598] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:41.918617] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E0F9] [lt=17] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:41.918643] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E0FA] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:41.918763] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E0FA] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:41.997371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E15] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.998068] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E16] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:41.998698] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E17] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:41.999334] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E18] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:41.999840] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E19] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:42.000454] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E1A] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:42.000968] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E1B] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:42.228708] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B7] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:42.228757] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B7] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:42.228773] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B7] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:42.228795] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B7] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:08:42.408586] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0EF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:42.439681] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0EF] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:42.439699] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0EF] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:42.439709] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0EF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:42.439733] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0EF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:42.439855] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0EF] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:42.439897] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0EF] [lt=31] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:42.440838] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E125] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:42.470606] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E125] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:42.470642] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E125] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:42.470652] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E125] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:42.470677] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E125] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:42.470795] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E125] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:42.470815] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E125] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:42.474156] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0D3] [lt=36] [dc=1] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:42.503280] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0D3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:42.503343] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0D3] [lt=60] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:42.503353] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0D3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:42.503381] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0D3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:42.503484] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0D3] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:42.503500] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0D3] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:42.634905] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCC] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:42.634944] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCC] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:42.634988] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCC] [lt=41] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:42.635005] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCC] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:08:42.815542] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:42.815578] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:42.815596] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:42.872903] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:42.872984] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276522228666, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1244, last_round_trip_time:769, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:42.873058] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=62] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:42.873964] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:42.874006] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276521531191, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-725, last_round_trip_time:793, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:42.874018] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:43.355842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EFB] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.356595] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EFC] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:43.357219] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EFD] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.377224] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528EFE] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:43.377888] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528EFF] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.378499] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F00] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:43.379182] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F01] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.440067] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0D4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:43.469868] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0D4] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:43.469905] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0D4] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:43.469920] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0D4] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:43.469984] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0D4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:43.470180] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0D4] [lt=105] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:43.470197] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0D4] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:43.470917] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E0FD] [lt=29] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:43.501531] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E0FD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:43.501567] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E0FD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:43.501577] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E0FD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:43.501602] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E0FD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:43.501707] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E0FD] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:43.501726] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E0FD] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:43.503683] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0F2] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:43.532139] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428528] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:43.532163] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428528] [lt=21] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:43.532174] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428528] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:43.532192] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428528] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=86, ddl_arg=NULL) [2024-01-03 18:08:43.532669] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0F2] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:43.532713] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0F2] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:43.532724] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0F2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:43.532748] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0F2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:43.532870] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0F2] [lt=39] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:43.532884] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0F2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:43.775290] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=32] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:43.775351] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:43.775367] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:43.776296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1DF] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.776846] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E0] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.777337] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E1] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.778015] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E2] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:43.818072] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:43.818104] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:43.818114] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:43.875682] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:43.875741] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276522228666, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1244, last_round_trip_time:769, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:43.875777] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:43.876429] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:43.876495] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276523532108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-750, last_round_trip_time:786, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:43.876531] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:44.001823] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E1D] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:44.002494] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E1E] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:08:44.003137] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E1F] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:44.003796] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E20] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:44.004428] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E21] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:44.005088] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E22] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:44.005688] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E23] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:44.229635] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:44.229700] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B8] [lt=61] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:44.229712] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B8] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:44.229729] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B8] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:08:44.354641] INFO [RS] ob_rs_rpc_processor.h:196 [2022][492][YB42C0A86EF1-00060E079C428469] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:44.470367] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0F3] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:44.497806] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0F3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:44.497839] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0F3] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:44.497849] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0F3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:44.497871] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0F3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:44.498003] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0F3] [lt=59] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:44.498016] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0F3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:44.501859] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E12A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:44.534149] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E12A] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:44.534175] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E12A] [lt=24] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:44.534184] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E12A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:44.534207] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E12A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:44.534261] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0D7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:44.534307] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E12A] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:44.534319] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E12A] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:44.566075] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0D7] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:44.566112] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0D7] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:44.566124] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0D7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:44.566149] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0D7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:44.566251] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0D7] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:44.566264] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0D7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:44.635841] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCD] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:44.635881] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCD] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:44.635893] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCD] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:44.635909] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCD] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:08:44.820775] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:44.820805] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:44.820815] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:44.878185] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=59] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:44.878272] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276524229601, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1422, last_round_trip_time:782, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:44.878300] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:44.879282] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:44.879325] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276523532108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-750, last_round_trip_time:786, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:44.879369] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:44.991493] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB15] [lt=84] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:45.380123] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F02] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.380792] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F03] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:08:45.381376] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F04] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.381931] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F05] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:45.382480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F06] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.383059] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F07] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:45.383738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F08] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.498150] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0D8] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:45.529772] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0D8] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:45.529796] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0D8] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:45.529805] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0D8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:45.529829] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0D8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:45.529916] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0D8] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:45.529930] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0D8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:45.533144] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428529] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:45.533169] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428529] [lt=22] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:45.533180] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428529] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:45.533195] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428529] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=84, ddl_arg=NULL) [2024-01-03 18:08:45.534490] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E102] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:45.567715] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E102] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:45.567756] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E102] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:45.567766] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E102] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:45.567790] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E102] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:45.567848] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0F6] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:45.567894] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E102] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:45.567906] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E102] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:45.598134] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0F6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:45.598173] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0F6] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:45.598183] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0F6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:45.598206] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0F6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:45.598303] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0F6] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:45.598317] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0F6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:45.598337] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:45.598355] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:45.598399] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:45.599095] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=19] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:45.599291] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:45.600248] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:45.600261] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:45.600524] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=33] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:45.601587] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=14] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:45.601593] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:45.601749] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:45.601772] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:45.601781] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:45.601861] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:45.601869] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:08:45.603268] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:45.603326] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:45.603337] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:45.605735] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:45.607344] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:45.720481] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943EF] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:45.778905] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E3] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.779380] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E4] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.779756] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.780221] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E6] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:45.823534] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:45.823562] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:45.823577] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:45.827018] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:45.827031] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=9] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:45.880852] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:45.880901] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276524229601, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1422, last_round_trip_time:782, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:45.880914] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:45.881496] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] ObTaskType::GENERIC REACH SYSLOG RATE LIMIT [2024-01-03 18:08:46.009583] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E29] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:46.010437] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E2A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:46.025624] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:46.025634] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:46.025646] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=174) [2024-01-03 18:08:46.025657] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=9] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:46.025665] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:46.025672] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=716207285) [2024-01-03 18:08:46.025701] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:46.025709] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E0F8] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:46.025738] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E0F9] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:08:46.025876] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E0F9] [lt=24] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:46.230619] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944B9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:46.230662] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944B9] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:46.230678] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944B9] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:46.230700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944B9] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:08:46.530092] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E12F] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:46.561806] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E12F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:46.561830] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E12F] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:46.561840] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E12F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:46.561863] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E12F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:46.562037] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E12F] [lt=102] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:46.562052] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E12F] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:46.568091] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0DB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:46.598266] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0DB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:46.598302] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0DB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:46.598312] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0DB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:46.598335] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0DB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:46.598432] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0DB] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:46.598445] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0DB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:46.598456] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E105] [lt=35] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:46.630559] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E105] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:46.630606] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E105] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:46.630619] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E105] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:46.630652] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E105] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:46.630786] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E105] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:46.630804] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E105] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:46.636723] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCE] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:46.636760] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCE] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:46.636776] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCE] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:46.636792] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:08:46.825897] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:46.825926] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:46.825939] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:46.883366] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:46.883416] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276526230589, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1346, last_round_trip_time:776, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:46.883436] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:46.884268] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:46.884311] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276525533114, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-640, last_round_trip_time:785, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:46.884322] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:47.493629] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F0A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.494330] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F0B] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:47.494972] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F0C] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.495554] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F0D] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:47.496119] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F0E] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.496672] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F0F] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:47.497143] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F10] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.534203] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:47.534263] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852A] [lt=54] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:47.534282] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852A] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:47.534302] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852A] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:08:47.562250] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E106] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:47.594189] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E106] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:47.594228] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E106] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:47.594238] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E106] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:47.594262] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E106] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:47.594364] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E106] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:47.594377] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E106] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:47.598551] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E0FC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:47.627969] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E0FC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:47.628013] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E0FC] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:47.628024] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E0FC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:47.628047] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E0FC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:47.628147] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E0FC] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:47.628159] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E0FC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:47.631057] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E132] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:47.660981] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E132] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:47.661015] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E132] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:47.661029] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E132] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:47.661051] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E132] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:47.661167] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E132] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:47.661187] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E132] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:47.781032] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.781537] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E8] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.782011] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1E9] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.782469] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1EA] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:47.828893] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:47.828922] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:47.828932] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:47.885856] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:47.885906] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276526230589, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1346, last_round_trip_time:776, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:47.885918] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:47.886760] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:47.886801] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276527534172, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-606, last_round_trip_time:784, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:47.886819] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:48.139996] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E2C] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:48.140607] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E2D] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:08:48.141303] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2021][490][YB42C0A86EF2-00060E079EC94E2E] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:48.141869] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E2F] [lt=80] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:48.142390] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E30] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:48.142845] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E31] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:48.143304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E32] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:48.231790] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944BA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:48.231832] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944BA] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:48.231847] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944BA] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:48.231863] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944BA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=108, ddl_arg=NULL) [2024-01-03 18:08:48.594546] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E133] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:48.634495] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E133] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:48.634532] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E133] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:48.634544] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E133] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:48.634576] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E133] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:48.634645] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0E0] [lt=41] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:48.634727] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E133] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:48.634748] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E133] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:48.637714] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBCF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:48.637758] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBCF] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:48.637771] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBCF] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:48.637788] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBCF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:08:48.666245] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0E0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:48.666279] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0E0] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:48.666292] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0E0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:48.666316] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0E0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:48.666385] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E109] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:48.666453] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0E0] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:48.666466] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0E0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:48.696196] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E109] [lt=39] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:48.696237] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E109] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:48.696248] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E109] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:48.696272] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E109] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:48.696386] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E109] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:48.696401] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E109] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:48.776846] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=10] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:48.776911] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:48.776941] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=12] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:48.831458] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:48.831486] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:48.831495] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:48.888651] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=60] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:48.888735] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276528231759, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1383, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:48.888778] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:48.889483] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:48.889571] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276527534172, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-606, last_round_trip_time:784, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:48.889629] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=52] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:49.355596] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42846A] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:49.498080] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F11] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.498898] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F12] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:49.499555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F13] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.500299] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F14] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:49.500926] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F15] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.501521] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F16] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:49.502032] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F17] [lt=54] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.535260] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852B] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:49.535333] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852B] [lt=68] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:49.535346] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852B] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:49.535364] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:08:49.634896] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E10A] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:49.665051] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E10A] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:49.665088] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E10A] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:49.665098] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E10A] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:49.665122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E10A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:49.665227] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E10A] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:49.665239] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E10A] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:49.666643] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E101] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:49.695398] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E101] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:49.695433] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E101] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:49.695443] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E101] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:49.695466] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E101] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:49.695568] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E101] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:49.695586] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E101] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:49.696570] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E136] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:49.727364] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E136] [lt=61] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:49.727401] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E136] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:49.727413] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E136] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:49.727450] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E136] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:49.727579] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E136] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:49.727595] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E136] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:49.727666] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=29] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:49.727686] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:49.727734] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:49.728627] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=34] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:49.728818] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:49.729620] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:49.729629] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:49.729801] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:49.730557] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:49.730563] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:49.730743] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:49.730765] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:49.730773] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:49.730854] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:49.730869] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:08:49.732307] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=4] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:49.732360] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=35] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:49.732372] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:49.734737] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:49.736367] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=61] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:49.783281] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1EC] [lt=9] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.783863] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E1ED] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.784427] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1EE] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.784914] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1EF] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:49.833869] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:49.833915] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:49.833930] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:49.891198] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=74] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:49.891276] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276528231759, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1383, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:49.891296] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:49.891993] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:49.892034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276529535229, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-646, last_round_trip_time:781, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:49.892065] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:49.950849] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:49.950859] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:49.992157] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB16] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:50.144166] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E33] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:50.144926] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E34] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:50.145724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E35] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:50.146384] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E36] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:50.147086] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E37] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:50.147773] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E38] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:50.148344] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E39] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:50.155775] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:50.155785] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:50.155796] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=175) [2024-01-03 18:08:50.155805] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:50.155814] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:50.155822] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=720337434) [2024-01-03 18:08:50.155852] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:50.155873] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E138] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:50.155903] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E139] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:50.156084] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E139] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:50.232775] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944BB] [lt=22] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:50.232824] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944BB] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:50.232840] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944BB] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:50.232862] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944BB] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:08:50.638650] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD0] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:50.638690] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD0] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:50.638701] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:50.638718] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:08:50.665454] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0E5] [lt=25] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:50.698156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0E5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:50.698196] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0E5] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:50.698207] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0E5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:50.698231] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0E5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:50.698309] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E10D] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:50.698393] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0E5] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:50.698409] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0E5] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:50.721361] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F0] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:08:50.728152] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E10D] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:50.728192] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E10D] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:50.728202] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E10D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:50.728226] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E10D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:50.728281] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E104] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:50.728335] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E10D] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:50.728348] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E10D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:50.760408] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E104] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:50.760446] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E104] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:50.760456] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E104] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:50.760485] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E104] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:50.760588] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E104] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:50.760601] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E104] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:50.837183] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:50.837229] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:50.837241] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:50.893797] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:50.893848] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276530232730, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1463, last_round_trip_time:811, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:50.893861] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:50.894800] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:50.894861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276529535229, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-646, last_round_trip_time:781, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:50.894874] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:51.502936] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F18] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.503840] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F19] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=34, ddl_arg=NULL) [2024-01-03 18:08:51.504557] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F1A] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.505387] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F1B] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:51.506011] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F1C] [lt=62] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.506534] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F1D] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:08:51.507163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF1-00060E079C528F1E] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.536231] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852C] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:51.536250] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852C] [lt=16] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:51.536260] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:51.536276] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=79, ddl_arg=NULL) [2024-01-03 18:08:51.698595] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E105] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:51.728276] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E105] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:51.728310] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E105] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:51.728319] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E105] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:51.728343] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E105] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:51.728444] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E105] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:51.728458] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E105] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:51.728494] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E13C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:51.759223] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E13C] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:51.759254] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E13C] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:51.759263] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E13C] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:51.759286] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E13C] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:51.759380] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E13C] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:51.759394] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E13C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:51.760761] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0E8] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:51.785756] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F0] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.786290] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F1] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.786679] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F2] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.787083] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F3] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:51.791355] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0E8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:51.791404] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0E8] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:51.791417] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0E8] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:51.791442] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0E8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:51.791549] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0E8] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:51.791563] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0E8] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:51.840043] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:51.840105] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=56] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:51.840116] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:51.896418] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:51.896470] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276530232730, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1463, last_round_trip_time:811, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:51.896482] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:51.897207] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:51.897270] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276531536200, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-692, last_round_trip_time:778, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:51.897298] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:52.149268] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E3A] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:52.149940] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E3B] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:08:52.150669] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E3C] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:52.151460] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E3D] [lt=103] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:52.152090] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E3E] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:52.152652] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E3F] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:52.153213] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E40] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:52.233834] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944BC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:52.233872] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944BC] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:52.233884] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944BC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:52.233905] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944BC] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:08:52.639491] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:52.639531] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD1] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:52.639542] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:52.639559] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:08:52.728610] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0E9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:52.762317] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0E9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:52.762351] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0E9] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:52.762361] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0E9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:52.762385] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0E9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:52.762428] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E112] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:52.762482] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0E9] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:52.762502] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0E9] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:52.792560] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E112] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:52.792595] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E112] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:52.792609] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E112] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:52.792643] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E112] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:52.792712] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E108] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:52.792773] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E112] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:52.792786] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E112] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:52.822732] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E108] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:52.822769] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E108] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:52.822781] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E108] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:52.822804] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E108] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:52.822889] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E108] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:52.822901] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E108] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:52.842496] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:52.842527] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:52.842537] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:52.899075] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=68] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:52.899148] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276532233802, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1513, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:52.899186] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:52.899784] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:52.899846] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276531536200, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-692, last_round_trip_time:778, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:52.899885] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:53.508078] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F20] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.508858] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F21] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:08:53.509595] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F22] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.510491] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F23] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:53.511134] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F24] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.511735] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F25] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:53.512284] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F26] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.537062] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852D] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:53.537086] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852D] [lt=20] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:53.537097] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852D] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:53.537112] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:08:53.762711] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E109] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:53.794199] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E109] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:53.794235] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E109] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:53.794251] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E109] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:53.794285] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E109] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:53.794350] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E141] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:53.794422] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E109] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:53.794435] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E109] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:53.824965] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E141] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:53.825003] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E141] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:53.825013] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E141] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:53.825035] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E141] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:53.825089] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0EC] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:53.825182] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E141] [lt=61] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:53.825196] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E141] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:53.845820] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:53.845851] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:53.845860] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:53.845880] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:53.845894] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:53.845971] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=22] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:53.846678] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:53.846917] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:53.847799] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:53.847807] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:53.848005] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:53.848925] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:53.848932] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:53.849140] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:53.849163] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:53.849171] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:08:53.849250] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:53.849271] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:08:53.850642] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:53.850700] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:53.850724] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:53.852558] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0EC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:53.852590] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0EC] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:53.852600] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0EC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:53.852623] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0EC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:53.852716] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0EC] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:53.852729] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0EC] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:53.853382] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:53.854974] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=84] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:53.901868] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:53.901917] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276532233802, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1513, last_round_trip_time:821, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:53.901930] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:53.902149] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:53.902190] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276533537018, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-708, last_round_trip_time:752, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:53.902217] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:53.927713] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:53.927788] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=53] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:53.927804] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:53.928750] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F5] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.929268] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F6] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.929734] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E1F7] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:53.930176] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F8] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:54.083998] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:54.084017] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=14] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:54.154282] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E42] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:54.155095] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E43] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:08:54.155880] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E44] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:54.156654] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF2-00060E079EC94E45] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:54.157217] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF2-00060E079EC94E46] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:54.157674] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E47] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:54.158206] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E48] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:54.278897] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:54.278905] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:54.278915] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=176) [2024-01-03 18:08:54.278922] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:54.278927] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:54.278933] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=724460545) [2024-01-03 18:08:54.278986] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:54.278993] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E118] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:54.279018] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E119] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:54.279118] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E119] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:54.357790] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42846B] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:54.640292] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:54.640335] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD2] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:54.640346] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD2] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:54.640361] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD2] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:08:54.794643] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0ED] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:54.830506] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0ED] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:54.830545] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0ED] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:54.830560] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0ED] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:54.830594] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0ED] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:54.830681] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E10C] [lt=26] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:54.830733] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0ED] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:54.830746] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0ED] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:54.848240] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:54.848282] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:54.848297] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:54.862487] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E10C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:54.862536] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E10C] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:54.862548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E10C] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:54.862571] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E10C] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:54.862656] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E11A] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:54.862740] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E10C] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:54.862753] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E10C] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:54.890394] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E11A] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:54.890428] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E11A] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:54.890438] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E11A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:54.890461] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E11A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:54.890556] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E11A] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:54.890569] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E11A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:54.904938] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:54.905020] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=35] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276534234685, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1641, last_round_trip_time:825, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:54.905034] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:54.905189] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:54.905252] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276533537018, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-708, last_round_trip_time:752, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:54.905295] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:54.992817] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB17] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:08:55.513298] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F27] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.514050] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F28] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:08:55.516200] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F29] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.516792] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F2A] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:08:55.517329] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F2B] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.517806] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F2C] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:55.518315] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F2D] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.538104] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:55.538155] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852E] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:55.538166] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:55.538182] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852E] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:08:55.722232] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F1] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:08:55.830903] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E10D] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:55.850607] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:55.850624] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:55.850633] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:55.862352] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E10D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:55.862379] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E10D] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:55.862388] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E10D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:55.862421] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E10D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:55.862556] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E10D] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:55.862568] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E10D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:55.862896] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0F0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:55.892522] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0F0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:55.892560] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0F0] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:55.892580] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0F0] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:55.892613] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0F0] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:55.892727] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E148] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:55.892812] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0F0] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:55.892835] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0F0] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:55.907348] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:55.907397] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276534234685, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1641, last_round_trip_time:825, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:55.907409] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:55.907561] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:55.907602] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276535538074, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-617, last_round_trip_time:746, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:55.907627] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:55.922838] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E148] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:55.922874] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E148] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:55.922884] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E148] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:55.922907] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E148] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:55.923015] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E148] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:55.923028] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E148] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:55.930904] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1F9] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.931569] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1FA] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.932074] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1FB] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:55.932525] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1FC] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:56.159084] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E49] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:56.159833] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E4A] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:08:56.160523] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E4B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:56.161174] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E4C] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:56.161704] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E4D] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:56.162298] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E4E] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:56.162894] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E4F] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:56.235500] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944BE] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:56.235544] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944BE] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:56.235606] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944BE] [lt=58] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:56.235637] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944BE] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=172, ddl_arg=NULL) [2024-01-03 18:08:56.641212] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD3] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:56.641351] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD3] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:56.641395] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD3] [lt=39] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:56.641422] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD3] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=260, ddl_arg=NULL) [2024-01-03 18:08:56.853090] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:56.853119] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:56.853128] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:56.862712] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E11F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:56.894751] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E11F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:56.894789] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E11F] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:56.894799] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E11F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:56.894828] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E11F] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:56.894914] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E110] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:56.895033] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E11F] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:56.895050] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E11F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:56.910356] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:56.910435] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276536235469, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1628, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:56.910495] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=54] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:56.910527] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:56.910571] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276535538074, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-617, last_round_trip_time:746, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:56.910597] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:56.926533] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E110] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:56.926556] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E110] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:56.926566] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E110] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:56.926589] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E110] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:56.926672] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E120] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:56.926770] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E110] [lt=81] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:56.926814] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E110] [lt=37] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:56.958740] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E120] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:56.958778] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E120] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:56.958788] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E120] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:56.958813] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E120] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:56.958920] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E120] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:56.958934] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E120] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:57.539035] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42852F] [lt=15] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:57.539089] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42852F] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:57.539101] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42852F] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:57.539118] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42852F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:08:57.646004] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F2F] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.646714] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F30] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:08:57.647343] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F31] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.647863] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F32] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:57.648371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F33] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.648847] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F34] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:08:57.649342] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F35] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.855625] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:57.855655] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:57.855664] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:57.895210] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0F5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:57.913051] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:57.913081] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:57.913103] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276537538989, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-658, last_round_trip_time:741, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:57.913123] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276536235469, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1628, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:57.913126] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:57.913135] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:57.913156] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:08:57.913170] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:08:57.913267] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=17] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:08:57.914220] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:08:57.914420] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=23] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:08:57.915336] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:57.915344] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:57.915531] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:08:57.916464] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:08:57.916475] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:08:57.916723] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=36] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:08:57.916748] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:08:57.916757] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:08:57.916859] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=41] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:08:57.916869] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=8] [dc=0] broadcast root address succeed [2024-01-03 18:08:57.918182] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:08:57.918242] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:57.918253] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:08:57.920519] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:08:57.921987] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=75] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:08:57.927638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0F5] [lt=112] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:57.927657] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0F5] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:57.927666] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0F5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:57.927690] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0F5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:57.927755] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E14D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:57.927793] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0F5] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:57.927811] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0F5] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:57.933415] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF0-00060E079A34E1FD] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.934130] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1FE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.934631] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E1FF] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.935103] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E200] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:57.958112] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E14D] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:57.958131] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E14D] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:57.958140] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E14D] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:57.958163] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E14D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:57.958276] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E14D] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:57.958298] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E14D] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:57.959110] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E123] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:57.990742] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E123] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:57.990778] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E123] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:57.990787] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E123] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:57.990811] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E123] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:57.990911] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E123] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:57.990926] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E123] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:58.137429] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:08:58.137446] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=13] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:08:58.236937] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944BF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:58.236996] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944BF] [lt=56] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:58.237007] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944BF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:58.237025] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944BF] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=159, ddl_arg=NULL) [2024-01-03 18:08:58.298373] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E54] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:58.369394] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:58.369404] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:08:58.369416] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=177) [2024-01-03 18:08:58.369424] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:08:58.369432] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:08:58.369440] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=728551052) [2024-01-03 18:08:58.369469] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:08:58.369490] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E114] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:08:58.369520] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E115] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:08:58.369675] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E115] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:08:58.642445] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:58.642486] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD4] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:58.642497] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:58.642514] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:08:58.858050] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:58.858073] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:58.858089] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:58.916098] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:58.916118] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:58.916167] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276538236905, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1313, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:58.916180] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:58.916173] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276537538989, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-658, last_round_trip_time:741, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:58.916198] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:58.927917] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E116] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:58.929332] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:58.929413] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=45] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:58.929458] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:08:58.959933] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E116] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:58.960006] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E116] [lt=69] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:58.960021] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E116] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:58.960048] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E116] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:58.960147] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0F8] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:58.960172] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E116] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:58.960186] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E116] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:58.992739] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0F8] [lt=30] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:58.992787] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0F8] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:58.992801] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0F8] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:58.992834] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0F8] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:58.992900] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E126] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:58.993012] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0F8] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:58.993034] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0F8] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:59.024181] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E126] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:59.024218] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E126] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:59.024227] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E126] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:59.024252] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E126] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:59.024355] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E126] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:59.024370] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E126] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:59.358634] INFO [RS] ob_rs_rpc_processor.h:196 [2004][456][YB42C0A86EF1-00060E079C42846C] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:08:59.540122] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428530] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:08:59.540162] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428530] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:08:59.540178] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428530] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:08:59.540195] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428530] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:08:59.650257] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F36] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.651141] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F37] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:08:59.651878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F38] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.652436] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F39] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:59.652972] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F3A] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.653492] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F3B] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:08:59.653943] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F3C] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.860435] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:08:59.860466] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:08:59.860476] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:08:59.918545] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:59.918596] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276539540061, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-586, last_round_trip_time:757, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:59.918608] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:08:59.918703] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:08:59.918746] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276538236905, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1313, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:08:59.918762] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:08:59.935856] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E202] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.936395] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E203] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.936871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E204] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.937350] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E205] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:08:59.960338] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E127] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:59.991899] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E127] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:08:59.991937] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E127] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:08:59.991988] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E127] [lt=48] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:08:59.992014] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E127] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:08:59.992184] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E127] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:08:59.992206] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E127] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:08:59.993208] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E152] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:08:59.993504] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB18] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:00.021886] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E152] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:00.021924] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E152] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:00.021934] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E152] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:00.021982] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E152] [lt=30] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:00.022113] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E152] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:00.022127] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E152] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:00.024546] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0FB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:00.056414] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0FB] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:00.056452] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0FB] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:00.056463] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0FB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:00.056495] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0FB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:00.056623] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0FB] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:00.056638] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0FB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:00.238043] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:00.238092] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C0] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:00.238108] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C0] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:00.238129] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C0] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=121, ddl_arg=NULL) [2024-01-03 18:09:00.300842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E58] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:00.301583] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E59] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:09:00.302196] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E5A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:00.303105] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E5B] [lt=79] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:00.303718] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E5C] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:00.304257] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E5D] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:00.304772] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E5E] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:00.643313] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD5] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:00.643368] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD5] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:00.643381] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD5] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:00.643397] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD5] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:00.723039] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F2] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:00.862660] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:00.862673] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:00.862682] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:00.921542] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:00.921621] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276539540061, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-586, last_round_trip_time:757, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:00.921655] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:00.922311] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:00.922372] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276540238011, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1642, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:00.922409] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:00.992361] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0FC] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:01.023760] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0FC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:01.023795] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0FC] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:01.023805] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0FC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:01.023828] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0FC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:01.023892] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E11B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:01.023992] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0FC] [lt=78] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:01.024009] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0FC] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:01.055904] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E11B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:01.055942] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E11B] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:01.055972] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E11B] [lt=28] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:01.055997] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E11B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:01.056139] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E11B] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:01.056152] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E11B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:01.056792] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E12A] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:01.086811] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E12A] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:01.086862] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E12A] [lt=47] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:01.086877] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E12A] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:01.086909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E12A] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:01.087056] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E12A] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:01.087070] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E12A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:01.541264] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428531] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:01.541303] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428531] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:01.541314] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428531] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:01.541330] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428531] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:09:01.654896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F3D] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.655640] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F3E] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:01.656368] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F3F] [lt=66] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.657108] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F40] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=72, ddl_arg=NULL) [2024-01-03 18:09:01.657760] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F41] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.658310] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F42] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:01.658890] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F43] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.865068] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:01.865098] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:01.865107] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:01.924267] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:01.924325] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276541541234, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-570, last_round_trip_time:749, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:01.924364] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:01.924574] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:01.924615] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276540238011, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1642, last_round_trip_time:827, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:01.924641] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:01.924660] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:01.924673] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:01.924731] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:01.925399] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=26] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:01.925591] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:01.926403] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:01.926410] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:01.926582] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:01.927373] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:01.927381] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:01.927564] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:01.927589] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:01.927604] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:09:01.927717] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:01.927725] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:09:01.929195] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:01.929252] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:01.929262] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=8] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:01.931751] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:01.933307] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:01.938050] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E206] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.938480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E207] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.939026] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E208] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:01.939459] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E209] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:02.024170] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E12B] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:02.052598] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E12B] [lt=45] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:02.052667] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E12B] [lt=66] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:02.052678] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E12B] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:02.052701] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E12B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:02.052841] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E12B] [lt=63] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:02.052866] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E12B] [lt=17] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:02.056272] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E157] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:02.077302] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E157] [lt=6] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:02.077325] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E157] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:02.077332] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E157] [lt=6] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:02.077348] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E157] [lt=4] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:02.077411] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E157] [lt=7] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:02.077420] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E157] [lt=4] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:02.087208] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E0FF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:02.114828] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E0FF] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:02.114865] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E0FF] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:02.114882] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E0FF] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:02.114910] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E0FF] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:02.115059] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E0FF] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:02.115078] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E0FF] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:02.161042] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:02.161052] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:02.239052] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:02.239102] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C1] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:02.239114] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:02.239130] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:09:02.338616] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:02.338624] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:02.338634] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=178) [2024-01-03 18:09:02.338641] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:02.338646] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:02.338653] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=732520265) [2024-01-03 18:09:02.338673] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:02.338685] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E11F] [lt=11] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:02.338707] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E120] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:09:02.338808] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E120] [lt=12] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:02.644191] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD6] [lt=44] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:02.644226] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD6] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:02.644236] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD6] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:02.644251] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD6] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:09:02.867272] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:02.867299] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:02.867309] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:02.926618] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:02.926666] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276541541234, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-570, last_round_trip_time:749, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:02.926691] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:02.926923] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:02.926987] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276542239008, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1734, last_round_trip_time:833, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:02.927013] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:03.053101] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E121] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:03.081687] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E121] [lt=25] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:03.081731] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E121] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:03.081745] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E121] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:03.081822] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E121] [lt=59] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:03.081878] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E12E] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:03.081922] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E121] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:03.081934] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E121] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:03.107225] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E12E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:03.107260] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E12E] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:03.107269] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E12E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:03.107291] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E12E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:03.107386] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E12E] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:03.107399] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E12E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:03.115222] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E15A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:03.143292] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E15A] [lt=61] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:03.143308] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E15A] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:03.143317] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E15A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:03.143339] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E15A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:03.143428] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E15A] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:03.143442] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E15A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:03.542256] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428532] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:03.542298] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428532] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:03.542315] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428532] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:03.542335] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428532] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:09:03.659826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F45] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:03.660494] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F46] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:09:03.661244] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF1-00060E079C528F47] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:03.661884] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F48] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:03.662368] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F49] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:03.662908] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F4A] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:03.663352] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F4B] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:03.869934] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:03.869988] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=49] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:03.869998] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:03.928934] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:03.928996] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276543542228, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-694, last_round_trip_time:762, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:03.929009] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:03.929433] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:03.929481] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276542239008, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1734, last_round_trip_time:833, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:03.929511] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:04.073627] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E20B] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.074061] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E20C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.074406] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E20D] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.074808] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E20E] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.082066] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E15B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:04.109788] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E15B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:04.109823] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E15B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:04.109833] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E15B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:04.109855] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E15B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:04.109907] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E104] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:04.109943] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E15B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:04.109991] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E15B] [lt=42] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:04.136647] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E104] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:04.136681] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E104] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:04.136691] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E104] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:04.136713] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E104] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:04.136810] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E104] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:04.136822] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E104] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:04.143593] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E124] [lt=43] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:04.170122] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E124] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:04.170158] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E124] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:04.170168] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E124] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:04.170190] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E124] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:04.170286] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E124] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:04.170299] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E124] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:04.240115] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C2] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:04.240156] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C2] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:04.240174] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C2] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:04.240199] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C2] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:09:04.309726] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E67] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.310423] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E68] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:04.311120] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E69] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.311817] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E6A] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:04.312409] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2003][454][YB42C0A86EF2-00060E079EC94E6B] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.313196] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E6C] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:04.313785] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E6D] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:04.378710] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42846D] [lt=69] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:04.644977] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD7] [lt=21] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:04.645018] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD7] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:04.645052] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD7] [lt=31] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:04.645069] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD7] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=148, ddl_arg=NULL) [2024-01-03 18:09:04.872438] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:04.872504] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=60] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:04.872515] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:04.931998] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=92] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:04.932003] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:04.932050] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276543542228, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-694, last_round_trip_time:762, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:04.932051] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276544240073, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1707, last_round_trip_time:826, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:04.932123] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=67] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:04.932097] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=42] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:04.994266] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB19] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:05.110181] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E125] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:05.142462] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E125] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:05.142503] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E125] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:05.142513] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E125] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:05.142537] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E125] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:05.142656] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E125] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:05.142677] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E125] [lt=15] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:05.142649] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E133] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:05.173806] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E133] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:05.173852] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E133] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:05.173863] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E133] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:05.173888] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E133] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:05.173965] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E107] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:05.174057] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E133] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:05.174071] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E133] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:05.204624] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E107] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:05.204661] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E107] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:05.204672] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E107] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:05.204696] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E107] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:05.204797] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E107] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:05.204811] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E107] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:05.543266] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428533] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:05.543301] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428533] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:05.543311] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428533] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:05.543328] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428533] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=94, ddl_arg=NULL) [2024-01-03 18:09:05.664166] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F4C] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:05.664896] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F4D] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:09:05.665564] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F4E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:05.666154] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F4F] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:05.666815] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528F50] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:05.667386] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F51] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:05.667992] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F52] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:05.723853] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F3] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:05.875168] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:05.875199] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:05.875209] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:05.934805] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=41] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:05.934858] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276545543237, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:762, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:05.934918] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=55] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:05.935367] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:05.935432] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276544240073, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1707, last_round_trip_time:826, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:05.935473] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:05.935521] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=27] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:05.935542] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:05.935668] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=32] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:05.936476] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=38] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:05.936914] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=61] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:05.938011] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=69] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:05.938024] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:05.938392] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=33] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:05.939552] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=34] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:05.939564] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:05.939767] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:05.939789] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:05.939800] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:09:05.939911] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:05.939920] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:09:05.941426] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:05.941478] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=34] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:05.941489] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:05.943776] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:05.945376] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=34] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:06.075500] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E20F] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:06.076021] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E210] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:06.076457] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E211] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:06.076886] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E212] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:06.183062] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:06.183080] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=14] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:06.186566] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E108] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:06.186626] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E108] [lt=56] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:06.186643] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E108] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:06.186683] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E108] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:06.186772] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E160] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:06.186824] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E108] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:06.186847] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E108] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:06.218658] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E160] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:06.218695] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E160] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:06.218712] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E160] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:06.218747] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E160] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:06.218814] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E136] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:06.218856] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E160] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:06.218870] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E160] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:06.246281] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E136] [lt=25] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:06.246319] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E136] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:06.246329] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E136] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:06.246353] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E136] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:06.246449] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E136] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:06.246464] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E136] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:06.385157] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:06.385166] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:06.385176] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=179) [2024-01-03 18:09:06.385183] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:06.385189] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:06.385196] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=736566808) [2024-01-03 18:09:06.385221] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:06.385227] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E129] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:06.385253] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E12A] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:06.385379] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E12A] [lt=16] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:06.646013] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD8] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:06.646067] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD8] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:06.646077] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD8] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:06.646094] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=161, ddl_arg=NULL) [2024-01-03 18:09:06.877522] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:06.877550] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:06.877559] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:06.937381] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:06.937439] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276545543237, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:762, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:06.937459] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:06.937786] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:06.937828] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276546241370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1641, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:06.937853] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:07.187064] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E12B] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:07.219735] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E12B] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:07.219771] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E12B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:07.219781] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E12B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:07.219804] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E12B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:07.219870] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E10B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:07.219907] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E12B] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:07.219921] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E12B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:07.253789] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E10B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:07.253825] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E10B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:07.253835] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E10B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:07.253859] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E10B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:07.254010] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E10B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:07.253981] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E163] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:07.254024] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E10B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:07.288145] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E163] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:07.288192] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E163] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:07.288207] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E163] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:07.288242] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E163] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:07.288382] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E163] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:07.288401] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E163] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:07.544415] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428534] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:07.544465] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428534] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:07.544483] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428534] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:07.544508] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428534] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=144, ddl_arg=NULL) [2024-01-03 18:09:07.797124] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F54] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:07.797777] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F55] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:07.798403] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F56] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:07.798932] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F57] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:07.799401] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F58] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:07.799876] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F59] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:07.800358] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F5A] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:07.880383] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:07.880411] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:07.880421] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:07.940202] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:07.940269] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276547544367, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-568, last_round_trip_time:761, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:07.940300] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:07.940664] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:07.940706] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276546241370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1641, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:07.940733] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:08.077734] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E213] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.078263] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E214] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.078796] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E215] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.079339] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E216] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.220061] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E164] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:08.242679] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C4] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:08.242723] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C4] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:08.242740] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C4] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:08.242764] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C4] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=164, ddl_arg=NULL) [2024-01-03 18:09:08.252146] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E164] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:08.252196] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E164] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:08.252212] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E164] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:08.252241] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E164] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:08.252376] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E164] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:08.252396] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E164] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:08.254169] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E13B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:08.288848] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E13B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:08.288886] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E13B] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:08.288896] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E13B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:08.288919] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E13B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:08.288981] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E12E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:08.289064] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E13B] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:08.289079] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E13B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:08.318486] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E12E] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:08.318523] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E12E] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:08.318533] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E12E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:08.318557] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E12E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:08.318658] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E12E] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:08.318676] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E12E] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:08.446620] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E76] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.447256] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E77] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:08.447782] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E78] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.448279] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E79] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:08.448699] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E7A] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.449481] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E7B] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:08.450017] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E7C] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:08.646891] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBD9] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:08.646931] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBD9] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:08.646943] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBD9] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:08.646992] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBD9] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=146, ddl_arg=NULL) [2024-01-03 18:09:08.882626] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:08.882656] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:08.882665] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:08.942744] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:08.942793] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276547544367, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-568, last_round_trip_time:761, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:08.942806] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:08.943189] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:08.943231] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276548242605, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1708, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:08.943257] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:09.074212] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:09.074267] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=34] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:09.074284] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:09.252528] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E12F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:09.286844] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E12F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:09.286878] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E12F] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:09.286888] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E12F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:09.286911] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E12F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:09.287069] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E12F] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:09.287087] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E12F] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:09.289227] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E110] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:09.316422] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E110] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:09.316481] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E110] [lt=56] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:09.316491] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E110] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:09.316514] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E110] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:09.316615] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E110] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:09.316628] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E110] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:09.318870] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E167] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:09.349332] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E167] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:09.349376] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E167] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:09.349393] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E167] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:09.349427] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E167] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:09.349541] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E167] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:09.349554] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E167] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:09.379444] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42846E] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:09.545479] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428535] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:09.545499] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428535] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:09.545510] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428535] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:09.545526] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428535] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=80, ddl_arg=NULL) [2024-01-03 18:09:09.801153] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F5B] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:09.801984] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F5C] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=35, ddl_arg=NULL) [2024-01-03 18:09:09.802648] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F5D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:09.803305] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F5E] [lt=62] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:09.803869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F5F] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:09.804392] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F60] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:09.804895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F61] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:09.885530] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:09.885561] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:09.885570] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:09.945564] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=82] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:09.945615] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276549545450, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-646, last_round_trip_time:772, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:09.945667] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:09.945692] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:09.945740] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276548242605, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1708, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:09.945770] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:09.945790] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:09.945803] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:09.945863] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:09.946762] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=39] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:09.946994] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:09.948002] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=26] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:09.948011] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:09.948207] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:09.949090] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:09.949097] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:09.949308] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:09.949318] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:09.949326] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:09:09.949389] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=7] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:09.949403] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:09:09.950750] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:09.950806] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:09.950817] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:09.953195] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:09.954644] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=44] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:09.994984] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB1A] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:10.080130] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E218] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.080784] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E219] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.081308] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21A] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.081738] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21B] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.169107] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:10.169121] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:10.243762] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C5] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:10.243786] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C5] [lt=21] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:10.243796] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C5] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:10.243812] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C5] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=117, ddl_arg=NULL) [2024-01-03 18:09:10.287263] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E168] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:10.348548] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E140] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:10.348585] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E140] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:10.348597] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E140] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:10.348633] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E140] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:10.348763] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E140] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:10.348776] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E140] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:10.349704] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E132] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:10.358024] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:10.358033] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:10.358043] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=180) [2024-01-03 18:09:10.358050] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:10.358058] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:10.358064] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=740539677) [2024-01-03 18:09:10.358092] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E114] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:10.380942] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E132] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:10.381005] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E132] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:10.381015] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E132] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:10.381038] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E132] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:10.381137] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E132] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:10.381150] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E132] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:10.381179] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E133] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:09:10.381309] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E133] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:10.450872] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E7D] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.451571] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E7E] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:10.452102] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E7F] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.452630] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E80] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:10.453147] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E81] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.453692] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E82] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:10.454163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF2-00060E079EC94E83] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:10.647641] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:10.647661] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDA] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:10.647672] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:10.647688] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=82, ddl_arg=NULL) [2024-01-03 18:09:10.724646] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F4] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:10.887916] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:10.887965] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:10.887976] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:10.948052] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:10.948102] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276549545450, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-646, last_round_trip_time:772, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:10.948122] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:10.948177] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:10.948224] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276550243698, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1845, last_round_trip_time:878, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:10.948268] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:11.317033] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E134] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:11.349152] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E134] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:11.349189] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E134] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:11.349199] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E134] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:11.349222] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E134] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:11.349272] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E16B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:11.349323] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E134] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:11.349335] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E134] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:11.378669] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E16B] [lt=70] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:11.378708] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E16B] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:11.378717] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E16B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:11.378740] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E16B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:11.378837] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E16B] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:11.378849] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E16B] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:11.381297] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E143] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:11.409677] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E143] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:11.409715] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E143] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:11.409726] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E143] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:11.409755] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E143] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:11.409908] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E143] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:11.409928] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E143] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:11.546435] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428536] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:11.546489] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428536] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:11.546504] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428536] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:11.546521] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428536] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:11.805807] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F62] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:11.806660] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F63] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:11.807244] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F64] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:11.807987] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F65] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:11.808572] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF1-00060E079C528F66] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:11.809188] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F67] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:11.809679] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F68] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:11.890738] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:11.890768] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:11.890777] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:11.950935] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:11.951007] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276551546401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-691, last_round_trip_time:767, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:11.951020] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:11.951133] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:11.951176] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276550243698, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1845, last_round_trip_time:878, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:11.951202] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:12.082500] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21C] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.082991] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.083468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21E] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.083845] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E21F] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.244785] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:12.244821] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C6] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:12.244833] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:12.244856] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C6] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:09:12.349456] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E144] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:12.382183] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E144] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:12.382220] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E144] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:12.382230] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E144] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:12.382254] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E144] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:12.382319] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E119] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:12.382358] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E144] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:12.382373] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E144] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:12.414656] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E119] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:12.414691] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E119] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:12.414701] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E119] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:12.414733] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E119] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:12.414809] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E137] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:12.414840] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E119] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:12.414855] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E119] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:12.446485] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E137] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:12.446519] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E137] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:12.446529] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E137] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:12.446552] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E137] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:12.446654] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E137] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:12.446667] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E137] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:12.455119] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E84] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.455757] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E85] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:09:12.456475] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E86] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.457089] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E87] [lt=77] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:12.457598] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E88] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.458124] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E89] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:12.458649] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94E8A] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:12.648421] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDB] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:12.648459] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDB] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:12.648470] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:12.648491] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDB] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:09:12.893266] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:12.893295] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:12.893305] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:12.953461] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:12.953513] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276551546401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-691, last_round_trip_time:767, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:12.953561] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=44] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:12.953774] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:12.953817] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276552244722, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1799, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:12.953828] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:13.382529] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E138] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:13.412161] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E138] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:13.412197] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E138] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:13.412207] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E138] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:13.412231] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E138] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:13.412332] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E138] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:13.412347] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E138] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:13.415093] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E170] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:13.446439] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E170] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:13.446468] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E170] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:13.446481] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E170] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:13.446519] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E170] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:13.446646] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E170] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:13.446662] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E170] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:13.446810] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E147] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:13.476128] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E147] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:13.476165] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E147] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:13.476179] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E147] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:13.476215] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E147] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:13.476329] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E147] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:13.476343] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E147] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:13.476365] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:13.476383] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:13.476459] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:13.477195] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:13.477423] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:13.478428] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=31] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:13.478436] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:13.478659] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=33] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:13.479782] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=34] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:13.479794] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:13.480073] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:13.480109] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=33] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:13.480118] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:09:13.480200] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:13.480222] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:09:13.481629] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:13.481692] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=44] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:13.481703] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:13.484054] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=9] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:13.485540] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=42] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:13.547464] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428537] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:13.547508] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428537] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:13.547520] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428537] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:13.547536] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428537] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:09:13.703080] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:13.703091] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:13.810541] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F6A] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:13.811231] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F6B] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:13.811880] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F6C] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:13.812429] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F6D] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:13.813037] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF1-00060E079C528F6E] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:13.813597] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F6F] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:13.814142] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F70] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:13.884384] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:13.884392] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:13.884402] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=181) [2024-01-03 18:09:13.884410] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:13.884416] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:13.884423] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=744066036) [2024-01-03 18:09:13.884449] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:13.884457] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E149] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:13.896155] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:13.956158] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:13.956210] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276553547433, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-690, last_round_trip_time:783, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:13.956222] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:13.956434] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=46] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:13.956488] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276552244722, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1799, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:13.956520] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:13.956546] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E173] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:13.956715] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E173] [lt=25] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:14.245904] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C7] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:14.245933] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C7] [lt=24] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:14.245984] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C7] [lt=46] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:14.246003] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C7] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=142, ddl_arg=NULL) [2024-01-03 18:09:14.251231] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:14.251294] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:14.251311] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:14.252448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E221] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.252884] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E222] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.253322] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E223] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.253694] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E224] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.380456] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42846F] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:14.412508] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E14A] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:14.445214] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E14A] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:14.445253] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E14A] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:14.445262] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E14A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:14.445287] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E14A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:14.445416] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E14A] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:14.445430] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E14A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:14.446832] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E11E] [lt=35] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:14.459821] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF2-00060E079EC94E8C] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.460779] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E8D] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:09:14.461465] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF2-00060E079EC94E8E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.462174] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E8F] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:14.462839] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E90] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.463439] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E91] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:14.464123] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E92] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:14.475852] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E11E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:14.475888] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E11E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:14.475897] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E11E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:14.475921] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E11E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:14.476068] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E11E] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:14.476082] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E11E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:14.476452] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E13B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:14.506392] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E13B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:14.506428] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E13B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:14.506438] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E13B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:14.506463] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E13B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:14.506565] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E13B] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:14.506579] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E13B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:14.649281] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDC] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:14.649333] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDC] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:14.649346] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDC] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:14.649391] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDC] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=161, ddl_arg=NULL) [2024-01-03 18:09:14.898683] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:14.898725] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:14.898742] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:14.958751] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:14.958806] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276553547433, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-690, last_round_trip_time:783, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:14.958823] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:14.959151] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:14.959212] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276554245865, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1828, last_round_trip_time:887, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:14.959247] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:14.995614] INFO [RS] ob_rs_rpc_processor.h:196 [2007][462][YB42C0A86EF0-00060E079A24DB1B] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:15.445599] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E13C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:15.477151] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E13C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:15.477187] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E13C] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:15.477197] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E13C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:15.477221] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E13C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:15.477300] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E176] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:15.477352] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E13C] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:15.477366] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E13C] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:15.510109] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E176] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:15.510162] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E176] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:15.510178] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E176] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:15.510215] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E176] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:15.510303] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E14D] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:15.510400] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E176] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:15.510420] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E176] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:15.546793] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E14D] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:15.546838] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E14D] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:15.546852] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E14D] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:15.546887] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E14D] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:15.547077] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E14D] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:15.547097] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E14D] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:15.548513] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428538] [lt=15] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:15.548541] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428538] [lt=24] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:15.548559] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428538] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:15.548584] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428538] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:09:15.725383] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F5] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:15.814993] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F71] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:15.815641] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F72] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:15.816318] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F73] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:15.817045] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F74] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:15.817562] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F75] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:15.818169] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F76] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:15.818696] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F77] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:15.901371] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:15.901400] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:15.901410] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:15.961350] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:15.961401] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276555548471, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-637, last_round_trip_time:790, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:15.961414] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:15.961899] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:15.961983] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276554245865, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1828, last_round_trip_time:887, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:15.962015] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:16.247098] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C8] [lt=34] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:16.247139] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C8] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:16.247150] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C8] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:16.247167] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C8] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:09:16.254581] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E225] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.255118] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E226] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.257835] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E227] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.258461] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E228] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.465044] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E93] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.465758] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E94] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:09:16.466458] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E95] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.467065] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E96] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=32, ddl_arg=NULL) [2024-01-03 18:09:16.467699] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E97] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.468148] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E98] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:16.468583] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E99] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:16.477542] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E14E] [lt=26] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:16.508830] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E14E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:16.508865] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E14E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:16.508875] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E14E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:16.508903] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E14E] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:16.509087] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E14E] [lt=39] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:16.509104] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E14E] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:16.510573] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E123] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:16.538715] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E123] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:16.538752] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E123] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:16.538762] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E123] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:16.538785] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E123] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:16.538874] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E123] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:16.538886] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E123] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:16.547256] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E13F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:16.574982] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E13F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:16.575016] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E13F] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:16.575026] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E13F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:16.575049] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E13F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:16.575146] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E13F] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:16.575159] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E13F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:16.650242] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDD] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:16.650287] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDD] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:16.650302] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDD] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:16.650325] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDD] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:09:16.904118] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:16.904152] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:16.904162] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:16.964012] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:16.964082] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276555548471, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-637, last_round_trip_time:790, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:16.964109] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:16.964198] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=20] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:16.964240] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276556247066, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1759, last_round_trip_time:914, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:16.964270] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:16.964290] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:16.964303] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:16.964359] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=22] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:16.965121] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:16.965315] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:16.966129] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:16.966136] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:16.966310] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:16.967068] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:16.967074] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:16.967257] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:16.967273] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=14] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:16.967280] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:09:16.967356] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:16.967371] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:09:16.968573] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:16.968632] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:16.968648] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=14] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:16.971156] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:16.972545] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:17.188620] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:17.188631] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:17.401632] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:17.401642] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:17.401653] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=182) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:09:17.401675] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=21] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:17.401683] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:17.401691] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=747583304) [2024-01-03 18:09:17.401719] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:17.401741] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E127] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:17.509270] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E140] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:17.541410] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E140] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:17.541447] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E140] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:17.541457] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E140] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:17.541480] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E140] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:17.541538] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E17B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:17.541582] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E140] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:17.541595] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E140] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:17.549656] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428539] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:17.549687] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428539] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:17.549698] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428539] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:17.549714] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428539] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=93, ddl_arg=NULL) [2024-01-03 18:09:17.570581] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E17B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:17.570618] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E17B] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:17.570628] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E17B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:17.570651] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E17B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:17.570777] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E17B] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:17.570791] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E17B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:17.575301] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E151] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:17.906370] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:17.906398] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:17.906407] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:17.964617] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F79] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:17.965279] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F7A] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=41, ddl_arg=NULL) [2024-01-03 18:09:17.965918] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F7B] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:17.966463] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F7C] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:17.966642] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:17.966692] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276556247066, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1759, last_round_trip_time:914, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:17.966724] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:17.966779] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:17.966886] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=70] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276557549625, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-627, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:17.966912] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:17.966930] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F7D] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:17.967467] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F7E] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:17.967933] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F7F] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.248146] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944C9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:18.248184] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944C9] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:18.248242] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944C9] [lt=55] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:18.248260] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944C9] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=147, ddl_arg=NULL) [2024-01-03 18:09:18.259543] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF0-00060E079A34E229] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.260076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E22A] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.260508] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E22B] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.260994] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E22C] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.541768] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E153] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:18.574230] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E153] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:18.574265] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E153] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:18.574281] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E153] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:18.574305] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E153] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:18.574416] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E153] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:18.574438] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E153] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:18.574437] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E12A] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:18.596351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E9B] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.597009] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E9C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:18.597617] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E9D] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.598148] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94E9E] [lt=91] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:18.598675] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94E9F] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.599159] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EA0] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:18.599647] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA1] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:18.602783] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E12A] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:18.602821] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E12A] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:18.602831] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E12A] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:18.602855] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E12A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:18.602965] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E12A] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:18.602979] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E12A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:18.607257] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E17E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:18.635806] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E17E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:18.635846] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E17E] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:18.635856] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E17E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:18.635879] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E17E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:18.635976] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E17E] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:18.635989] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E17E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:18.651181] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDE] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:18.651221] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDE] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:18.651233] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:18.651249] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:09:18.908814] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:18.908844] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:18.908853] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:18.969126] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:18.969176] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276558248116, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1881, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:18.969188] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:18.969628] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:18.969671] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276557549625, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-627, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:18.969716] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=41] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:19.253225] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=12] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:19.253290] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=33] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:19.253319] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=12] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:19.381510] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428470] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:19.550823] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:19.550871] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853A] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:19.550887] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853A] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:19.550909] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853A] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:09:19.574582] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E17F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:19.603386] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E17F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:19.603418] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E17F] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:19.603428] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E17F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:19.603451] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E17F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:19.603523] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E145] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:19.603554] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E17F] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:19.603567] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E17F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:19.633788] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E145] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:19.633827] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E145] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:19.633837] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E145] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:19.633861] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E145] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:19.633977] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E145] [lt=40] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:19.633991] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E145] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:19.636130] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E156] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:19.663834] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E156] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:19.663869] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E156] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:19.663879] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E156] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:19.663906] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E156] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:19.664041] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E156] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:19.664054] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E156] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:19.911420] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:19.911449] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:19.911458] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:19.968834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F80] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:19.969607] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F81] [lt=52] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:19.970393] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F82] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:19.971036] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F83] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:19.971659] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F84] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:19.972127] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=72] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:19.972178] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F85] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:09:19.972178] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276559550783, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:818, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:19.972191] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:19.972260] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:19.972365] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276558248116, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1881, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:19.972414] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=41] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:19.972656] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F86] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:19.996240] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB1C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:20.249103] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CA] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:20.249134] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CA] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:20.249143] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CA] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:20.249159] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CA] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=84, ddl_arg=NULL) [2024-01-03 18:09:20.262437] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E22E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.263256] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E22F] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.263840] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E230] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.264234] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E231] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.600537] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA2] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.601382] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EA3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:20.602165] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA4] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.602729] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EA5] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:20.603260] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA6] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.603739] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E157] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:20.603828] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EA7] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:20.604447] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA8] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:20.636377] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E157] [lt=20] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:20.636413] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E157] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:20.636423] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E157] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:20.636447] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E157] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:20.636507] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E12F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:20.636583] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E157] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:20.636606] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E157] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:20.652031] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBDF] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:20.652092] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBDF] [lt=57] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:20.652104] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBDF] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:20.652121] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBDF] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:09:20.668301] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E12F] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:20.668354] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E12F] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:20.668369] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E12F] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:20.668392] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E12F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:20.668452] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E148] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:20.668535] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E12F] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:20.668557] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E12F] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:20.697641] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E148] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:20.697678] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E148] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:20.697692] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E148] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:20.697717] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E148] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:20.697813] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E148] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:20.697826] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E148] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:20.697848] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:20.697867] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:20.697933] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=23] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:20.698717] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:20.698914] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:20.699676] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=26] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:20.699683] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:20.699843] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:20.700612] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:20.700619] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:20.700778] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:20.700823] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=42] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:20.700832] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:20.700902] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=13] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:20.700918] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=15] [dc=0] broadcast root address succeed [2024-01-03 18:09:20.702260] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:20.702319] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=41] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:20.702330] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:20.704487] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:20.706000] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=82] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:20.726327] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F6] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:20.914232] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:20.914276] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:20.914295] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:20.920601] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:20.920612] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:20.974801] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:20.974851] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276559550783, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:818, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:20.974864] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:20.974940] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:20.975000] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276560249076, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1838, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:20.975012] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:21.128339] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:21.128350] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:21.128362] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=183) [2024-01-03 18:09:21.128370] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:21.128378] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:21.128386] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=751309998) [2024-01-03 18:09:21.128412] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:21.128433] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E14A] [lt=19] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:21.128461] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E14B] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:09:21.128601] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E14B] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:21.551933] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853B] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:21.552004] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853B] [lt=64] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:21.552022] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853B] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:21.552101] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853B] [lt=64] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=214, ddl_arg=NULL) [2024-01-03 18:09:21.636777] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E184] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:21.668543] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E184] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:21.668566] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E184] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:21.668575] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E184] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:21.668599] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E184] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:21.668722] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E184] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:21.668740] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E184] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:21.668756] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E15A] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:21.698367] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E15A] [lt=40] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:21.698403] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E15A] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:21.698417] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E15A] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:21.698441] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E15A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:21.698500] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E132] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:21.698540] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E15A] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:21.698554] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E15A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:21.729610] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E132] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:21.729646] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E132] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:21.729657] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E132] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:21.729682] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E132] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:21.729796] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E132] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:21.729815] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E132] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:21.916691] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:21.916720] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:21.916729] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:21.973720] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F87] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:21.974619] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F88] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:21.975255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F89] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:21.975780] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F8A] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:21.976266] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F8B] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:21.976749] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F8C] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:21.977209] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F8D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:21.977336] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:21.977386] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276561551889, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-708, last_round_trip_time:814, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:21.977457] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=66] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:21.977471] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:21.977513] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276560249076, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1838, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:21.977542] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:22.250123] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CB] [lt=26] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:22.250160] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CB] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:22.250170] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CB] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:22.250186] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=95, ddl_arg=NULL) [2024-01-03 18:09:22.265107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E232] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.265594] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E233] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.266164] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E234] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.266573] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E235] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.605430] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EA9] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.606562] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EAA] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=27, ddl_arg=NULL) [2024-01-03 18:09:22.607569] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF2-00060E079EC94EAB] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.608260] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EAC] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:22.608997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EAD] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.609622] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EAE] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:22.610183] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EAF] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:22.653281] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:22.653328] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE0] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:22.653344] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE0] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:22.653365] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE0] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=173, ddl_arg=NULL) [2024-01-03 18:09:22.668898] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E133] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:22.702686] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E133] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:22.702722] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E133] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:22.702736] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E133] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:22.702846] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E133] [lt=81] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:22.702984] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E14E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:22.703063] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E133] [lt=47] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:22.703087] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E133] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:22.735977] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E14E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:22.736002] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E14E] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:22.736012] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E14E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:22.736036] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E14E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:22.736110] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E187] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:22.736169] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E14E] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:22.736182] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E14E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:22.771139] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E187] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:22.771185] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E187] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:22.771199] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E187] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:22.771231] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E187] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:22.771388] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E187] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:22.771408] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E187] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:22.919508] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:22.919548] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:22.919563] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:22.980066] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:22.980086] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:22.980131] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276561551889, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-708, last_round_trip_time:814, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:22.980135] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276562250095, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1819, last_round_trip_time:862, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:22.980144] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:22.980149] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:23.553036] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853C] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:23.553081] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853C] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:23.553099] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853C] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:23.553123] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853C] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=121, ddl_arg=NULL) [2024-01-03 18:09:23.703352] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E188] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:23.741102] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E188] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:23.741160] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E188] [lt=53] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:23.741178] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E188] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:23.741208] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E188] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:23.741318] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E15F] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:23.741344] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E188] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:23.741362] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E188] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:23.777718] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E15F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:23.777767] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E15F] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:23.777779] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E15F] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:23.777809] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E15F] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:23.777929] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E136] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:23.777994] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E15F] [lt=72] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:23.778012] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E15F] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:23.812841] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E136] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:23.812893] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E136] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:23.812907] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E136] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:23.812942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E136] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:23.813078] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E136] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:23.813096] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E136] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:23.922532] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:23.922567] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:23.922577] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:23.978300] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F8F] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:23.979199] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F90] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=44, ddl_arg=NULL) [2024-01-03 18:09:23.980119] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F91] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:23.980865] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F92] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:23.982010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F93] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:23.982732] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F94] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:23.982811] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:23.982863] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276562250095, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1819, last_round_trip_time:862, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:23.982888] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:23.982976] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:23.983037] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276563553003, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-639, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:23.983068] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:23.983547] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F95] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.251503] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CC] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:24.251540] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CC] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:24.251551] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CC] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:24.251566] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:09:24.382524] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428471] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:24.427387] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:24.427451] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=41] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:24.427467] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:24.428438] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E237] [lt=67] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.429070] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF0-00060E079A34E238] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.429809] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E239] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.430447] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23A] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.611287] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF2-00060E079EC94EB1] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.612319] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EB2] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=56, ddl_arg=NULL) [2024-01-03 18:09:24.613418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EB3] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.614317] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EB4] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:24.615025] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF2-00060E079EC94EB5] [lt=88] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.615730] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EB6] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:24.616476] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EB7] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:24.654279] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:24.654303] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE1] [lt=20] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:24.654324] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE1] [lt=17] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:24.654347] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE1] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=112, ddl_arg=NULL) [2024-01-03 18:09:24.741522] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E137] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:24.777314] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E137] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:24.777349] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E137] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:24.777362] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E137] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:24.777393] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E137] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:24.777521] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E137] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:24.777542] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E137] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:24.778161] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E153] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:24.809802] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E153] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:24.809840] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E153] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:24.809853] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E153] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:24.809886] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E153] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:24.810029] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E153] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:24.810051] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E153] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:24.813421] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E162] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:24.844504] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E162] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:24.844555] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E162] [lt=47] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:24.844567] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E162] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:24.844597] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E162] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:24.844765] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E162] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:24.844788] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E162] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:24.844825] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=12] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:24.844854] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=13] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:24.844968] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=26] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:24.845908] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=24] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:24.846207] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:24.847350] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:24.847359] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:24.847574] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:24.848792] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:24.848803] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:24.849050] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:24.849079] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=25] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:24.849092] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:09:24.849205] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:24.849220] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:09:24.850725] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:24.850788] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=44] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:24.850801] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:24.853402] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=12] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:24.855161] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=44] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:24.925305] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:24.925344] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:24.925391] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=44] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:24.985489] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:24.985545] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276564251473, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1781, last_round_trip_time:869, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:24.985559] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:24.985922] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:24.985983] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276563553003, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-639, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:24.985996] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:24.997091] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB1D] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:25.124256] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:25.124267] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:25.377429] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:25.377439] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:25.377452] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=184) [2024-01-03 18:09:25.377460] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:25.377467] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:25.377475] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=755559088) [2024-01-03 18:09:25.377514] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:25.377523] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E164] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:25.377554] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E165] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:09:25.377668] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E165] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:25.554395] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853D] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:25.554466] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853D] [lt=66] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:25.554490] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853D] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:25.554593] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853D] [lt=87] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=244, ddl_arg=NULL) [2024-01-03 18:09:25.727426] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F7] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:25.777850] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E18D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:25.811250] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E18D] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:25.811287] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E18D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:25.811297] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E18D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:25.811322] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E18D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:25.811439] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E18D] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:25.811436] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E13A] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:25.811453] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E18D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:25.843189] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E13A] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:25.843228] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E13A] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:25.843238] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E13A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:25.843262] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E13A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:25.843383] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E13A] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:25.843406] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E13A] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:25.845003] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E156] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:25.888023] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E156] [lt=44] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:25.888073] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E156] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:25.888088] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E156] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:25.888123] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E156] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:25.888265] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E156] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:25.888284] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E156] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:25.928303] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:25.928332] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:25.928342] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:25.984622] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F96] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:25.985580] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F97] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=29, ddl_arg=NULL) [2024-01-03 18:09:25.986377] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F98] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:25.987116] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F99] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:25.987938] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F9A] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:25.988496] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=54] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:25.988549] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276564251473, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1781, last_round_trip_time:869, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:25.988561] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:25.988682] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F9B] [lt=62] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:25.988767] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=75] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:25.988810] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276565554352, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-477, last_round_trip_time:830, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:25.988837] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:25.989365] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F9C] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.252739] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CD] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:26.252798] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CD] [lt=54] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:26.252816] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CD] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:26.252843] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CD] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=173, ddl_arg=NULL) [2024-01-03 18:09:26.431693] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23B] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.432581] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23C] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.433103] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23D] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.433548] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.617497] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EB8] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.618264] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EB9] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:26.619244] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EBA] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.620051] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EBB] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:26.620729] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EBC] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.621302] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EBD] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:26.621925] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EBE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:26.655403] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE2] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:26.655453] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE2] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:26.655470] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE2] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:26.655490] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE2] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=141, ddl_arg=NULL) [2024-01-03 18:09:26.811637] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E157] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:26.846031] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E157] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:26.846078] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E157] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:26.846095] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E157] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:26.846128] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E157] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:26.846187] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E168] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:26.846282] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E157] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:26.846305] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E157] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:26.878119] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E168] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:26.878167] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E168] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:26.878181] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E168] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:26.878215] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E168] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:26.878338] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E168] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:26.878358] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E168] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:26.888567] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E190] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:26.921434] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E190] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:26.921480] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E190] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:26.921495] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E190] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:26.921528] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E190] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:26.921671] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E190] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:26.921686] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E190] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:26.931065] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:26.931107] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:26.931124] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:26.991476] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:26.991565] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:26.991562] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276565554352, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-477, last_round_trip_time:830, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:26.991575] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:26.991607] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276566252672, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1667, last_round_trip_time:849, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:26.991629] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:27.555841] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:27.555881] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853E] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:27.555899] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853E] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:27.555926] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853E] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:09:27.846479] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E191] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:27.877883] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E191] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:27.877912] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E191] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:27.877922] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E191] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:27.877977] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E191] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:27.878137] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E191] [lt=41] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:27.878158] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E191] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:27.878507] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E13F] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:27.910784] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E13F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:27.910856] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E13F] [lt=69] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:27.910867] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E13F] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:27.910892] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E13F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:27.911005] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E13F] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:27.911020] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E13F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:27.921840] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E16B] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:27.933818] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:27.933850] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:27.933859] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:27.960508] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E16B] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:27.960547] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E16B] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:27.960557] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E16B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:27.960582] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E16B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:27.960677] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E16B] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:27.960693] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E16B] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:27.994422] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:27.994474] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276567555809, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-572, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:27.994476] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:27.994486] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:27.994537] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276566252672, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1667, last_round_trip_time:849, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:27.994557] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:28.117989] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528F9E] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.118905] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528F9F] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:28.119664] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA0] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.120236] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FA1] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=32, ddl_arg=NULL) [2024-01-03 18:09:28.120747] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA2] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.121599] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FA3] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:09:28.122474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA4] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.254407] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CE] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:28.254446] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CE] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:28.254458] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:28.254475] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=112, ddl_arg=NULL) [2024-01-03 18:09:28.434630] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E23F] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.435291] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E240] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.435928] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E241] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.436631] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E242] [lt=54] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.656443] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE3] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:28.656483] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE3] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:28.656495] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:28.656512] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE3] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=108, ddl_arg=NULL) [2024-01-03 18:09:28.771113] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC0] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.771933] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EC1] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:28.772978] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC2] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.773717] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EC3] [lt=69] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:28.774565] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC4] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.775502] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EC5] [lt=63] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:28.776128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC6] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:28.878315] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E15C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:28.910940] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E15C] [lt=25] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:28.910996] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E15C] [lt=53] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:28.911007] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E15C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:28.911032] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E15C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:28.911139] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E15C] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:28.911152] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E15C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:28.911193] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E16C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:28.936634] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:28.936653] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:28.936667] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:28.947291] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E16C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:28.947335] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E16C] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:28.947349] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E16C] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:28.947389] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E16C] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:28.947532] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E16C] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:28.947554] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E16C] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:28.947590] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=10] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:28.947614] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=11] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:28.947713] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=35] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:28.948559] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=36] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:28.948847] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:28.950011] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:28.950062] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=48] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:28.950227] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:28.951520] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=25] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:28.951528] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:28.951911] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:28.951939] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:28.951974] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=31] [dc=0] start to process rs list update task [2024-01-03 18:09:28.952088] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=35] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:28.952102] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:09:28.953702] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:28.953773] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:28.953801] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=25] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:28.956504] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=10] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:28.958312] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=45] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:28.960911] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E142] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:28.994893] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E142] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:28.994924] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E142] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:28.994934] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E142] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:28.994976] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E142] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:28.995067] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E142] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:28.995081] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E142] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:28.997710] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:28.997761] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276567555809, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-572, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:28.997774] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:28.997933] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:28.998001] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276568254369, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1635, last_round_trip_time:876, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:28.998014] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:29.228589] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:29.228599] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:29.383567] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428472] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:29.449492] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:29.449505] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:29.449517] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=185) [2024-01-03 18:09:29.449525] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:29.449533] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:29.449540] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=759631153) [2024-01-03 18:09:29.449567] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:29.449594] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E16E] [lt=24] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:29.449642] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E16F] [lt=17] [dc=0] start to process rs list update task [2024-01-03 18:09:29.449780] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E16F] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:29.557118] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42853F] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:29.557159] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42853F] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:29.557171] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42853F] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:29.557191] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42853F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:09:29.911388] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E143] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:29.939553] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:29.939587] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:29.939597] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:29.946720] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E143] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:29.946764] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E143] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:29.946778] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E143] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:29.946814] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E143] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:29.946973] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E143] [lt=47] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:29.946995] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E143] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:29.947720] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E198] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:29.978871] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E198] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:29.978908] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E198] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:29.978926] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E198] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:29.979002] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E198] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:29.979128] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E198] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:29.979141] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E198] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:29.995243] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E170] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:29.997830] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB1E] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:30.000854] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:30.000893] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:30.000907] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276568254369, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1635, last_round_trip_time:876, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:30.000919] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:30.000988] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276569557085, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-628, last_round_trip_time:888, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:30.001034] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:30.026084] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E170] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:30.026118] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E170] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:30.026132] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E170] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:30.026156] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E170] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:30.026250] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E170] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:30.026263] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E170] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:30.026842] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=26] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:09:30.123900] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.124880] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FA6] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:30.125756] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA7] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.126497] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FA8] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:30.127351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FA9] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.128207] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FAA] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:30.128783] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FAB] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.257409] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944CF] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:30.257451] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944CF] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:30.257463] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944CF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:30.257481] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944CF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:30.437567] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E244] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.438269] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E245] [lt=157] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.438975] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E246] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.439654] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E247] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.657364] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:30.657406] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE4] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:30.657418] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE4] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:30.657475] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE4] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=149, ddl_arg=NULL) [2024-01-03 18:09:30.728383] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F8] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:30.777338] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC7] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.778915] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EC8] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:30.779753] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EC9] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.780577] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ECA] [lt=85] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:30.781245] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ECB] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.782012] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ECC] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:30.782749] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ECD] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:30.943000] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=47] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:30.943015] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:30.943025] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:30.947163] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E146] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:30.978173] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E146] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:30.978213] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E146] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:30.978229] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E146] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:30.978262] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E146] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:30.978394] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E146] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:30.978419] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E146] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:30.979258] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E163] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:31.003652] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:31.003699] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:31.003716] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276569557085, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-628, last_round_trip_time:888, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:31.003729] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:31.003740] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276570257363, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1562, last_round_trip_time:876, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:31.003752] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:31.010741] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E163] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:31.010789] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E163] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:31.010801] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E163] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:31.010826] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E163] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:31.010972] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E163] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:31.010995] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E163] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:31.026401] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E147] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:31.058634] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E147] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:31.058713] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E147] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:31.058725] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E147] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:31.058749] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E147] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:31.058853] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E147] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:31.058866] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E147] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:31.558496] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428540] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:31.558536] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428540] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:31.558548] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428540] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:31.558566] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428540] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:31.945724] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:31.945766] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:31.945784] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:31.978544] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E173] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:32.006403] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:32.006454] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276571558451, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-497, last_round_trip_time:903, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:32.006458] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=42] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:32.006467] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:32.006523] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276570257363, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1562, last_round_trip_time:876, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:32.006538] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:32.011203] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E173] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:32.011241] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E173] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:32.011252] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E173] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:32.011277] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E173] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:32.011341] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E19F] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:32.011435] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E173] [lt=56] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:32.011458] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E173] [lt=15] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:32.043923] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E19F] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:32.043988] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E19F] [lt=62] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:32.044000] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E19F] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:32.044025] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E19F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:32.044138] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E19F] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:32.044154] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E19F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:32.059020] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E166] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:32.090490] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E166] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:32.090540] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E166] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:32.090556] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E166] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:32.090589] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E166] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:32.090728] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E166] [lt=39] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:32.090749] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E166] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:32.130077] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FAC] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.130975] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FAD] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=36, ddl_arg=NULL) [2024-01-03 18:09:32.131744] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FAE] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.132545] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FAF] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:32.133339] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF1-00060E079C528FB0] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.134265] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FB1] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:32.135238] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FB2] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.258823] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:32.258873] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D0] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:32.258889] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D0] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:32.258912] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D0] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:09:32.440672] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF0-00060E079A34E248] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.441262] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E249] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.441767] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E24A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.442231] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E24B] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.658336] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE5] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:32.658398] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE5] [lt=56] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:32.658414] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE5] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:32.658438] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE5] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:09:32.783990] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF2-00060E079EC94ECE] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.784980] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ECF] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=42, ddl_arg=NULL) [2024-01-03 18:09:32.785632] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ED0] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.786273] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ED1] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:32.786895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ED2] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.787509] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ED3] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:32.788172] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ED4] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:32.948734] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:32.948778] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:32.948795] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:33.009100] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:33.009152] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276571558451, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-497, last_round_trip_time:903, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:33.009164] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:33.009772] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:33.009841] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276572258791, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1670, last_round_trip_time:910, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:33.009875] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:33.009909] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=13] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:33.009931] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:33.010087] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=33] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:33.011060] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:33.011269] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:33.011611] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E167] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:33.012414] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:33.012422] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:33.012655] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:33.013803] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:33.013811] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:33.014053] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=17] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:33.014064] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:33.014072] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:33.014156] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:33.014167] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=9] [dc=0] broadcast root address succeed [2024-01-03 18:09:33.015756] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:33.015813] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:33.015825] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:33.019190] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:33.021158] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:33.047228] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E167] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:33.047288] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E167] [lt=55] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:33.047303] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E167] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:33.047337] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E167] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:33.047465] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E167] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:33.047394] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E14C] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:33.047479] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E167] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:33.082722] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E14C] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:33.082760] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E14C] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:33.082776] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E14C] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:33.082809] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E14C] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:33.082967] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E14C] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:33.082991] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E14C] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:33.090929] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E176] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:33.124214] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E176] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:33.124258] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E176] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:33.124268] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E176] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:33.124295] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E176] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:33.124434] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E176] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:33.124456] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E176] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:33.302425] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:33.302443] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=12] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:33.559715] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428541] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:33.559753] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428541] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:33.559765] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428541] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:33.559781] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428541] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:09:33.566381] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:33.566414] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=26] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:33.566431] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=10] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=186) [2024-01-03 18:09:33.566445] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=12] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:33.566455] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=8] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:33.566474] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=16] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=763748085) [2024-01-03 18:09:33.566512] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=10] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:33.566541] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E1A3] [lt=26] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:33.566581] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E1A4] [lt=11] [dc=0] start to process rs list update task [2024-01-03 18:09:33.566814] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E1A4] [lt=29] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:33.951548] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:33.951561] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:33.951570] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:34.047667] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1A5] [lt=73] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:34.081113] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1A5] [lt=39] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:34.081163] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1A5] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:34.081179] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1A5] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:34.081215] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1A5] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:34.081345] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1A5] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:34.081361] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1A5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:34.083166] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E16A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:34.115510] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E16A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:34.115545] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E16A] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:34.115559] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E16A] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:34.115597] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E16A] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:34.115727] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E16A] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:34.115741] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E16A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:34.124638] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E14F] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:34.136419] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FB4] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.137255] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FB5] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:09:34.138280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FB6] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.139174] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF1-00060E079C528FB7] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:09:34.140079] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FB8] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.140675] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FB9] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:34.141642] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FBA] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.158558] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E14F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:34.158606] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E14F] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:34.158620] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E14F] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:34.158664] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E14F] [lt=18] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:34.158823] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E14F] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:34.158848] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E14F] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:34.260168] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:34.260241] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D1] [lt=69] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:34.260254] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D1] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:34.260271] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=140, ddl_arg=NULL) [2024-01-03 18:09:34.384706] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428473] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:34.594509] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=26] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:34.594645] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=103] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:34.594663] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:34.595683] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E24D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.596254] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E24E] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.596722] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E24F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.597291] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E250] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.659251] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE6] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:34.659290] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE6] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:34.659302] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:34.659319] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:09:34.789410] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ED6] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.790351] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ED7] [lt=63] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:09:34.791140] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94ED8] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.791816] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94ED9] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:34.792493] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EDA] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.793154] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EDB] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:34.793871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EDC] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:34.954102] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:34.954139] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:34.954148] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:34.998478] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB1F] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:35.014462] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:35.014514] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276573559682, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-678, last_round_trip_time:934, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:35.014526] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:35.015403] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:35.015495] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276574260136, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1745, last_round_trip_time:926, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:35.015524] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:35.081591] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E150] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:35.117774] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E150] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:35.117819] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E150] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:35.117834] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E150] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:35.117871] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E150] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:35.117991] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E17B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:35.118049] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E150] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:35.118067] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E150] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:35.150205] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E17B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:35.150242] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E17B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:35.150253] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E17B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:35.150278] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E17B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:35.150405] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E17B] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:35.150419] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E17B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:35.159015] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1A8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:35.190404] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1A8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:35.190440] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1A8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:35.190451] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1A8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:35.190476] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1A8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:35.190590] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1A8] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:35.190612] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1A8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:35.560831] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428542] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:35.560887] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428542] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:35.560903] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428542] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:35.560920] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428542] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:35.729416] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943F9] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:35.957889] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:35.957932] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:35.957971] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:36.018023] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:36.018074] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276575560800, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:951, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:36.018087] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:36.018645] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:36.018691] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276574260136, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1745, last_round_trip_time:926, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:36.018704] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:36.118217] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1A9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:36.143101] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FBB] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.144082] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FBC] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:36.145059] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FBD] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.145927] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FBE] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:36.146822] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FBF] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.147571] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FC0] [lt=61] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:36.148323] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FC1] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.150993] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1A9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:36.151039] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1A9] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:36.151049] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1A9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:36.151073] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1A9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:36.151145] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E16F] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:36.151172] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1A9] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:36.151185] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1A9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:36.182893] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E16F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:36.182920] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E16F] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:36.182930] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E16F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:36.182974] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E16F] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:36.183091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E16F] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:36.183104] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E16F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:36.190790] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E153] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:36.223137] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E153] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:36.223171] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E153] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:36.223180] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E153] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:36.223203] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E153] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:36.223321] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E153] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:36.223371] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E153] [lt=43] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:36.261430] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D2] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:36.261460] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D2] [lt=26] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:36.261480] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D2] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:36.261508] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D2] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:09:36.598184] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E251] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.599198] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E252] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.599675] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E253] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.600324] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E254] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.660240] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE7] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:36.660280] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE7] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:36.660292] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE7] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:36.660314] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE7] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:09:36.795247] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EDD] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.796128] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EDE] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:36.796998] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EDF] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.797902] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EE0] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:36.798862] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EE1] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.799560] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EE2] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:36.800341] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EE3] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:36.961002] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:36.961019] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:36.961028] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:37.021250] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:37.021345] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276575560800, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:951, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:37.021525] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:37.021529] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=176] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:37.021592] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276576261383, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1780, last_round_trip_time:943, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:37.021604] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:37.021623] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:37.021638] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:37.021684] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:37.022741] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=53] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:37.023042] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:37.024070] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=23] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:37.024077] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:37.024250] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:37.025361] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:37.025368] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:37.025576] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:37.025598] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:37.025606] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:37.025685] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:37.025706] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:09:37.027695] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:37.027742] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=21] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:37.027761] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=16] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:37.030566] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=10] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:37.032170] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:37.151328] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E154] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:37.185380] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E154] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:37.185419] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E154] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:37.185429] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E154] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:37.185453] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E154] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:37.185531] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E180] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:37.185627] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E154] [lt=80] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:37.185642] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E154] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:37.216390] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E180] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:37.216425] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E180] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:37.216435] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E180] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:37.216458] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E180] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:37.216559] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E180] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:37.216572] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E180] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:37.223546] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1AC] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:37.259658] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1AC] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:37.259706] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1AC] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:37.259724] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1AC] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:37.259760] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1AC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:37.259866] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1AC] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:37.259879] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1AC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:37.303505] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:37.303522] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:37.529622] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:37.529640] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:37.529658] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=10] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=187) [2024-01-03 18:09:37.529671] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:37.529683] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=9] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:37.529698] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=11] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=767711309) [2024-01-03 18:09:37.529729] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=9] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:37.529744] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E173] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:37.529798] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E174] [lt=13] [dc=0] start to process rs list update task [2024-01-03 18:09:37.530058] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E174] [lt=85] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:37.562172] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428543] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:37.562216] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428543] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:37.562230] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428543] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:37.562291] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428543] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=169, ddl_arg=NULL) [2024-01-03 18:09:37.963484] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:37.963514] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:37.963523] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:38.024368] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:38.024420] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276577562128, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-558, last_round_trip_time:942, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:38.024441] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:38.024452] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:38.024486] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276576261383, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1780, last_round_trip_time:943, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:38.024512] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:38.185792] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E175] [lt=80] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:38.218461] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E175] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:38.218504] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E175] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:38.218520] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E175] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:38.218557] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E175] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:38.218632] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E157] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:38.218692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E175] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:38.218710] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E175] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:38.246990] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E157] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:38.247027] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E157] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:38.247040] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E157] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:38.247069] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E157] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:38.247165] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E157] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:38.247178] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E157] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:38.260066] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E183] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:38.262756] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D3] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:38.262792] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D3] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:38.262803] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:38.262820] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:09:38.293263] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E183] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:38.293316] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E183] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:38.293292] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2020][488][YB42C0A86EF1-00060E079C528FC3] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.293332] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E183] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:38.293372] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E183] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:38.293484] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E183] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:38.293498] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E183] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:38.294390] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FC4] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:09:38.295477] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FC5] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.296210] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FC6] [lt=76] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:38.296984] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FC7] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.297787] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FC8] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:38.298505] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FC9] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.601223] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E255] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.601827] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E256] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.602621] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E257] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.603333] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E258] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.661118] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE8] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:38.661151] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE8] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:38.661161] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE8] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:38.661175] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE8] [lt=5] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=90, ddl_arg=NULL) [2024-01-03 18:09:38.961654] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EE5] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.962440] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EE6] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:09:38.963141] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EE7] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.963821] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EE8] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:38.964386] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EE9] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.965053] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EEA] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:38.965706] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EEB] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:38.966574] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:38.966646] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=62] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:38.966665] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:39.027458] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=54] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:39.027578] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=48] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276577562128, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-558, last_round_trip_time:942, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:39.027600] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:39.027748] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:39.027815] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276578262696, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1848, last_round_trip_time:958, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:39.027858] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:39.218935] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E184] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:39.251245] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E184] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:39.251281] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E184] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:39.251291] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E184] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:39.251324] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E184] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:39.251401] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1B1] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:39.251460] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E184] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:39.251474] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E184] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:39.283711] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1B1] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:39.283758] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1B1] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:39.283772] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1B1] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:39.283804] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1B1] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:39.283944] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1B1] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:39.283987] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1B1] [lt=33] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:39.293676] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E178] [lt=94] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:39.326051] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E178] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:39.326088] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E178] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:39.326098] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E178] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:39.326122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E178] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:39.326224] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E178] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:39.326236] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E178] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:39.385770] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428474] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:39.563591] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428544] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:39.563638] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428544] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:39.563655] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428544] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:39.563686] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428544] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=141, ddl_arg=NULL) [2024-01-03 18:09:39.596429] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:39.596500] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=36] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:39.596560] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=45] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:39.969039] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:39.969052] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:39.969062] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:39.999328] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB20] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:40.030131] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:40.030203] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276578262696, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1848, last_round_trip_time:958, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:40.030223] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:40.030388] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:40.030452] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276579563547, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-751, last_round_trip_time:980, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:40.030470] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:40.251637] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E179] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:40.264006] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D4] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:40.264089] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D4] [lt=76] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:40.264109] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D4] [lt=16] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:40.264135] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D4] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=205, ddl_arg=NULL) [2024-01-03 18:09:40.299826] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FCA] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.300352] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E179] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:40.300399] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E179] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:40.300413] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E179] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:40.300448] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E179] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:40.300553] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E15C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:40.300602] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E179] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:40.300621] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E179] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:40.300892] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FCB] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:09:40.301724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FCC] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.302467] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FCD] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:40.303209] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FCE] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.304113] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FCF] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:40.305088] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD0] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.334729] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E15C] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:40.334775] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E15C] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:40.334792] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E15C] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:40.334828] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E15C] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:40.334887] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1B4] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:40.334930] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E15C] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:40.334943] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E15C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:40.366142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1B4] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:40.366179] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1B4] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:40.366190] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1B4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:40.366215] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1B4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:40.366321] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1B4] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:40.366335] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1B4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:40.604173] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E25A] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.604808] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E25B] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.605333] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E25C] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.605831] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E25D] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.662137] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBE9] [lt=53] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:40.662178] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBE9] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:40.662189] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBE9] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:40.662207] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBE9] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:09:40.730450] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FA] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:40.966879] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EEC] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.967705] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EED] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=32, ddl_arg=NULL) [2024-01-03 18:09:40.968483] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EEE] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.969164] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EEF] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:40.969928] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF0] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.970699] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EF1] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:40.971614] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF2] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:40.971765] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:40.971812] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:40.971828] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:41.033497] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:41.033509] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:41.033549] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276579563547, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-751, last_round_trip_time:980, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:41.033552] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276580263934, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1776, last_round_trip_time:978, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:41.033562] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:41.033565] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:41.033586] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:41.033599] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:41.033642] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:41.034430] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=38] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:41.034643] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:41.035699] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:41.035708] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:41.035985] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:41.037182] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:41.037189] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:41.037404] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:41.037418] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=12] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:41.037427] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:41.037508] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:41.037516] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:09:41.038896] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:41.038980] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:41.039018] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=35] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:41.041761] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=32] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:41.043448] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=42] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:41.300128] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:41.300138] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:41.300808] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1B5] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:41.332851] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1B5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:41.332869] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1B5] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:41.332879] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1B5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:41.332903] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1B5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:41.333010] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1B5] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:41.333031] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1B5] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:41.335134] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E189] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:41.375687] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E189] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:41.375725] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E189] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:41.375739] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E189] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:41.375779] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E189] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:41.375937] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E189] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:41.376030] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E189] [lt=81] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:41.376118] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E15F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:41.406546] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E15F] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:41.406566] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E15F] [lt=18] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:41.406575] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E15F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:41.406598] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E15F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:41.406752] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E15F] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:41.406774] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E15F] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:41.540983] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:41.540993] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:41.541004] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=188) [2024-01-03 18:09:41.541013] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:41.541020] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:41.541029] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=771722641) [2024-01-03 18:09:41.541072] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=11] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:41.541085] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E17D] [lt=11] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:41.541133] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E17E] [lt=20] [dc=0] start to process rs list update task [2024-01-03 18:09:41.541304] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E17E] [lt=30] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:41.564703] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428545] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:41.564742] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428545] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:41.564760] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428545] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:41.564785] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428545] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:09:41.974476] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:41.974489] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:41.974499] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:42.036277] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:42.036330] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276580263934, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1776, last_round_trip_time:978, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:42.036342] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:42.036596] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:42.036647] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276581564662, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-711, last_round_trip_time:975, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:42.036724] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=70] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:42.265546] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D5] [lt=17] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:42.265604] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D5] [lt=54] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:42.265617] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D5] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:42.265635] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D5] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:09:42.306361] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD1] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.307276] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FD2] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:42.308155] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD3] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.309002] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FD4] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:42.309743] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD5] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.310445] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FD6] [lt=69] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:42.311084] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD7] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.333292] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E17F] [lt=25] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:42.365847] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E17F] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:42.365889] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E17F] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:42.365899] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E17F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:42.365926] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E17F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:42.366090] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E17F] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:42.366106] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E17F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:42.376211] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1B8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:42.408039] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1B8] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:42.408086] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1B8] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:42.408102] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1B8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:42.408136] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1B8] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:42.408204] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E162] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:42.408264] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1B8] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:42.408283] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1B8] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:42.439020] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E162] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:42.439066] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E162] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:42.439077] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E162] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:42.439102] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E162] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:42.439232] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E162] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:42.439257] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E162] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:42.606988] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E25E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.607521] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E25F] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.607989] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E260] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.608665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E261] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.663233] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBEA] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:42.663275] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBEA] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:42.663287] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBEA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:42.663311] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBEA] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:09:42.972773] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF3] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.973596] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EF4] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:42.974456] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF5] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.975352] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EF6] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:42.976418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF7] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:42.977401] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EF8] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:42.977581] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:42.977610] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:42.977620] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:42.978114] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EF9] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:43.039289] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=76] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:43.039349] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276582265510, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1914, last_round_trip_time:1029, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:43.039392] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:43.039587] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:43.039646] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276581564662, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-711, last_round_trip_time:975, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:43.039667] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:43.366275] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E163] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:43.398175] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E163] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:43.398214] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E163] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:43.398224] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E163] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:43.398248] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E163] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:43.398352] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E163] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:43.398366] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E163] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:43.408454] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E18E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:43.439339] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E18E] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:43.439387] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E18E] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:43.439400] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E18E] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:43.439425] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E18E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:43.439522] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E18E] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:43.439535] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E18E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:43.439565] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E182] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:43.469938] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E182] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:43.470001] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E182] [lt=59] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:43.470014] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E182] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:43.470045] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E182] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:43.470152] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E182] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:43.470165] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E182] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:43.565846] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428546] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:43.565885] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428546] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:43.565896] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428546] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:43.565913] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428546] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:09:43.980630] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:43.980694] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=58] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:43.980704] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:44.042134] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:44.042214] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276582265510, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1914, last_round_trip_time:1029, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:44.042305] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=83] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:44.043178] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:44.043242] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276583565815, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-669, last_round_trip_time:979, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:44.043277] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:44.266704] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D6] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:44.266759] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D6] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:44.266774] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D6] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:44.266798] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D6] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:09:44.312216] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FD9] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.313244] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FDA] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=51, ddl_arg=NULL) [2024-01-03 18:09:44.314131] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FDB] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.314807] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FDC] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:44.315576] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FDD] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.316211] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FDE] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:44.316783] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FDF] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.386659] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428475] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:44.398538] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E183] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:44.432658] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E183] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:44.432696] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E183] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:44.432706] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E183] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:44.432731] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E183] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:44.432879] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E183] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:44.432901] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E183] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:44.439680] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1BD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:44.470474] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1BD] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:44.470510] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1BD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:44.470521] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1BD] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:44.470547] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1BD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:44.470688] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1BD] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:44.470682] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E166] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:44.470701] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1BD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:44.500563] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E166] [lt=19] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:44.500609] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E166] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:44.500625] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E166] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:44.500658] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E166] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:44.500818] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E166] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:44.500836] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E166] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:44.664318] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBEB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:44.664362] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBEB] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:44.664378] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBEB] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:44.664401] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBEB] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:09:44.766576] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=41] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:44.766632] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=35] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:44.766649] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:44.767804] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E263] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.768326] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E264] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.768828] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E265] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.769435] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E266] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.979318] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EFB] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.980369] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EFC] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:09:44.981155] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EFD] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.982170] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94EFE] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:44.983284] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94EFF] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:44.983592] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:44.983625] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:44.983635] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:44.984088] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F00] [lt=63] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:44.984841] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F01] [lt=66] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:45.000154] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB21] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:45.045226] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:45.045302] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276584266658, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1832, last_round_trip_time:1020, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:45.045330] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:45.045842] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:45.045883] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276583565815, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-669, last_round_trip_time:979, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:45.045908] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:45.045928] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:45.045942] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:45.046010] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:45.046849] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=43] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:45.047224] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=23] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:45.048374] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=30] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:45.048386] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:45.048714] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=17] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:45.049676] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:45.049683] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:45.049859] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:45.049895] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=31] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:45.049908] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=10] [dc=0] start to process rs list update task [2024-01-03 18:09:45.050064] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=36] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:45.050086] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:09:45.051733] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:45.051805] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=44] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:45.051829] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:45.054800] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:45.056590] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:45.337294] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:45.337304] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:45.433119] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E167] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:45.468932] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E167] [lt=40] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:45.468972] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E167] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:45.468982] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E167] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:45.469007] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E167] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:45.469124] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E167] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:45.469140] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E167] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:45.470879] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E193] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:45.503100] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E193] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:45.503136] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E193] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:45.503146] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E193] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:45.503170] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E193] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:45.503246] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E186] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:45.503322] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E193] [lt=61] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:45.503336] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E193] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:45.536324] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E186] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:45.536360] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E186] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:45.536370] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E186] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:45.536394] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E186] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:45.536481] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E186] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:45.536495] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E186] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:45.613442] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:45.613453] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:45.613465] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=189) [2024-01-03 18:09:45.613478] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:45.613492] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=12] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:45.613526] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=30] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=775795137) [2024-01-03 18:09:45.613559] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=9] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:45.613582] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E1C1] [lt=20] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:45.613647] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E1C2] [lt=30] [dc=0] start to process rs list update task [2024-01-03 18:09:45.613840] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E1C2] [lt=12] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:45.731285] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FB] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:45.986682] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:45.986727] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:45.986742] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:46.048308] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=74] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:46.048372] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276584266658, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1832, last_round_trip_time:1020, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:46.048385] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:46.048480] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:46.048522] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276585567454, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-298, last_round_trip_time:989, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:46.048562] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:46.268273] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D7] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:46.268324] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D7] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:46.268341] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D7] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:46.268365] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D7] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=141, ddl_arg=NULL) [2024-01-03 18:09:46.317861] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF1-00060E079C528FE0] [lt=74] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.318907] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF1-00060E079C528FE1] [lt=180] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=43, ddl_arg=NULL) [2024-01-03 18:09:46.319781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FE2] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.320543] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FE3] [lt=57] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:46.321341] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FE4] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.321994] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FE5] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:46.322633] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FE6] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.469317] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1C3] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:46.511007] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1C3] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:46.511049] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1C3] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:46.511064] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1C3] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:46.511094] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1C3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:46.511177] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E16A] [lt=34] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:46.511242] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1C3] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:46.511262] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1C3] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:46.542372] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E16A] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:46.542409] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E16A] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:46.542430] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E16A] [lt=19] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:46.542464] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E16A] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:46.542533] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E196] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:46.542580] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E16A] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:46.542594] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E16A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:46.573275] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E196] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:46.573313] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E196] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:46.573323] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E196] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:46.573347] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E196] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:46.573452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E196] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:46.573475] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E196] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:46.665323] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBEC] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:46.665388] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBEC] [lt=61] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:46.665400] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBEC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:46.665418] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBEC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:09:46.770507] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2014][476][YB42C0A86EF0-00060E079A34E267] [lt=54] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.771263] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E268] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.771872] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E269] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.772418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E26A] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.986146] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F02] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.987146] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F03] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:46.987923] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F04] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.988694] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F05] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:46.989474] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F06] [lt=52] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:46.989569] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=47] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:46.989603] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:46.989613] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:46.991082] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F07] [lt=88] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:46.992043] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F08] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:47.050931] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:47.051010] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:47.051031] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276586268229, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1463, last_round_trip_time:1035, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:47.051046] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:47.051052] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276585567454, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-298, last_round_trip_time:989, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:47.051064] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:47.511432] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E197] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:47.543064] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E197] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:47.543103] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E197] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:47.543113] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E197] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:47.543137] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E197] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:47.543211] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E18B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:47.543284] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E197] [lt=60] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:47.543299] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E197] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:47.568871] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428548] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:47.568910] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428548] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:47.568922] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428548] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:47.568940] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428548] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:09:47.577202] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E18B] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:47.577220] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E18B] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:47.577230] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E18B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:47.577254] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E18B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:47.577337] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1C6] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:47.577357] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E18B] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:47.577371] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E18B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:47.609174] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1C6] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:47.609211] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1C6] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:47.609221] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1C6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:47.609244] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1C6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:47.609343] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1C6] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:47.609357] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1C6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:47.992929] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:47.992987] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=51] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:47.992997] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:48.053703] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:48.053754] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276587568840, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:1000, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:48.053769] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:48.053777] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:48.053819] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276586268229, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1463, last_round_trip_time:1035, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:48.053851] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:48.269661] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D8] [lt=35] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:48.269698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D8] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:48.269732] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D8] [lt=31] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:48.269750] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D8] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=162, ddl_arg=NULL) [2024-01-03 18:09:48.471487] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FE8] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.472532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FE9] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:48.474590] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FEA] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.475465] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FEB] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:48.476368] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FEC] [lt=101] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.477228] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FED] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:48.477862] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FEE] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.543480] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1C7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:48.577019] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1C7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:48.577091] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1C7] [lt=69] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:48.577105] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1C7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:48.577137] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1C7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:48.577292] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1C7] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:48.577311] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1C7] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:48.577537] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E16F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:48.609075] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E16F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:48.609128] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E16F] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:48.609143] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E16F] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:48.609176] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E16F] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:48.609280] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E16F] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:48.609294] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E16F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:48.609528] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E18E] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:48.639807] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E18E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:48.639845] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E18E] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:48.639855] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E18E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:48.639881] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E18E] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:48.639997] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E18E] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:48.640011] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E18E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:48.666372] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBED] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:48.666424] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBED] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:48.666443] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBED] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:48.666468] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBED] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:09:48.773476] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E26B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.774145] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E26C] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.774799] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF0-00060E079A34E26D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.775454] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E26E] [lt=94] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:48.996095] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:48.996127] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:48.996137] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:49.056626] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:49.056677] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276587568840, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:1000, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:49.056690] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:49.056712] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:49.056725] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:49.056771] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=9] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:49.056827] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:49.056877] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276588269592, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1815, last_round_trip_time:1048, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:49.056913] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:49.057623] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:49.057893] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=16] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:49.059170] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=31] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:49.059184] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:49.059488] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=28] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:49.060672] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:49.060678] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:49.060934] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:49.060964] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=27] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:49.060973] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:09:49.061085] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=41] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:49.061096] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=9] [dc=0] broadcast root address succeed [2024-01-03 18:09:49.062684] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:49.062746] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:49.062764] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=15] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:49.065766] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=52] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:49.067598] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=35] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:49.141727] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F0A] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:49.142902] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F0B] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:49.143787] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F0C] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:49.144631] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F0D] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:49.145477] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F0E] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:49.146255] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F0F] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:49.146996] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F10] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:49.334622] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:49.334634] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:49.387602] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428476] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:49.570271] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428549] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:49.570319] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428549] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:49.570332] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428549] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:49.570349] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428549] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=124, ddl_arg=NULL) [2024-01-03 18:09:49.572734] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:49.572744] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:49.572756] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=190) [2024-01-03 18:09:49.572765] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:49.572774] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:49.572782] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=779754395) [2024-01-03 18:09:49.572810] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:49.572818] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E1CB] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:49.577475] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E18F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:49.615411] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E18F] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:49.615462] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E18F] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:49.615478] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E18F] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:49.615504] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E18F] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:49.615573] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E19C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:49.615638] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E18F] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:49.615652] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E18F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:49.648292] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E19C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:49.648327] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E19C] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:49.648336] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E19C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:49.648362] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E19C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:49.648445] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E172] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:49.648527] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E19C] [lt=43] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:49.648546] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E19C] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:49.679404] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E172] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:49.679441] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E172] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:49.679459] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E172] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:49.679492] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E172] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:49.679607] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E172] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:49.679628] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E172] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:49.679697] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E173] [lt=12] [dc=0] start to process rs list update task [2024-01-03 18:09:49.679873] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E173] [lt=12] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:49.768396] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:49.768430] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=14] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:49.768703] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=185] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:49.998687] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=47] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:49.998717] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:49.998726] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:50.000779] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB22] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:09:50.059451] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=64] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:50.059503] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276588269592, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1815, last_round_trip_time:1048, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:50.059580] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=73] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:50.059542] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=75] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:50.059672] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=91] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276589570228, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-521, last_round_trip_time:995, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:50.059692] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:50.271234] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944D9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:50.271273] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944D9] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:50.271308] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944D9] [lt=32] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:50.271326] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944D9] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:09:50.479116] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FEF] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.481709] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FF0] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:09:50.482597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FF1] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.483383] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FF2] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:50.484115] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FF3] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.485092] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FF4] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:50.485802] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FF5] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.615797] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E174] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:50.647349] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E174] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:50.647391] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E174] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:50.647406] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E174] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:50.647442] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E174] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:50.647621] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E174] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:50.647643] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E174] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:50.648726] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1CE] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:50.667494] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBEE] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:50.667533] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBEE] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:50.667544] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBEE] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:50.667565] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBEE] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:09:50.677694] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1CE] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:50.677738] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1CE] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:50.677751] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1CE] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:50.677783] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1CE] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:50.677924] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1CE] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:50.677944] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1CE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:50.679826] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E19F] [lt=19] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:50.711560] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E19F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:50.711606] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E19F] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:50.711620] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E19F] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:50.711653] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E19F] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:50.711782] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E19F] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:50.711796] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E19F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:50.732322] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FC] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:50.776527] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E270] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.777446] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E271] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.778129] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E272] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:50.778795] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E273] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:51.002032] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:51.002074] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:51.002092] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:51.063187] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:51.063288] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276590271203, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1464, last_round_trip_time:1052, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:51.063316] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:51.063332] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:51.063371] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276589570228, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-521, last_round_trip_time:995, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:51.063404] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:51.148410] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F11] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:51.149330] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F12] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:51.150069] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F13] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:51.150822] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F14] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:51.151841] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F15] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:51.152682] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F16] [lt=71] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:51.153374] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F17] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:51.571619] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:51.571653] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854A] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:51.571666] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:51.571727] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854A] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=186, ddl_arg=NULL) [2024-01-03 18:09:51.647841] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1A0] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:51.677664] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1A0] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:51.677699] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1A0] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:51.677709] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1A0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:51.677734] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1A0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:51.677825] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1A0] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:51.677838] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1A0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:51.678123] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E194] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:51.710691] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E194] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:51.710741] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E194] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:51.710757] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E194] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:51.710792] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E194] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:51.710917] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E194] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:51.710978] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E194] [lt=52] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:51.712012] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E177] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:51.743224] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E177] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:51.743259] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E177] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:51.743268] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E177] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:51.743292] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E177] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:51.743380] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E177] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:51.743393] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E177] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:52.004895] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:52.004929] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:52.004944] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:52.065985] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=45] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:52.066037] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276590271203, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1464, last_round_trip_time:1052, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:52.066062] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:52.066173] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:52.066233] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276591571542, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-631, last_round_trip_time:1017, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:52.066266] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:52.272400] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DA] [lt=18] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:52.272454] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DA] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:52.272472] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DA] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:52.272494] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DA] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:09:52.487036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FF6] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.487943] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FF7] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:52.488771] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FF8] [lt=100] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.489610] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FF9] [lt=90] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:09:52.490422] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FFA] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.491184] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FFB] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:09:52.492195] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF1-00060E079C528FFC] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.668514] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBEF] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:52.668563] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBEF] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:52.668575] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBEF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:52.668593] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBEF] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:09:52.678027] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E178] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:52.712361] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E178] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:52.712395] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E178] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:52.712405] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E178] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:52.712429] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E178] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:52.712516] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1D3] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:52.712538] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E178] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:52.712553] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E178] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:52.743717] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1D3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:52.743763] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1D3] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:52.743777] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1D3] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:52.743810] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1D3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:52.743893] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1A3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:52.744012] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1D3] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:52.744027] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1D3] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:52.774986] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1A3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:52.775020] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1A3] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:52.775030] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1A3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:52.775054] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1A3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:52.775162] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1A3] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:52.775183] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1A3] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:52.775219] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=15] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:52.775237] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:52.775289] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:52.776007] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:52.776202] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:52.777328] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=26] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:52.777342] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:52.777595] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:52.778550] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=35] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:52.778569] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=17] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:52.778846] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=16] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:52.778856] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:52.778870] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=12] [dc=0] start to process rs list update task [2024-01-03 18:09:52.779079] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=88] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:52.779097] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=16] [dc=0] broadcast root address succeed [2024-01-03 18:09:52.779847] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E274] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.780435] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E275] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.780842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E276] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.780941] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:52.781030] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=70] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:52.781042] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:52.781402] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E277] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:52.783781] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:52.785468] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:53.008094] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:53.008123] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:53.008137] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:53.048260] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:53.048272] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:53.068896] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=84] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:53.068979] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276591571542, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-631, last_round_trip_time:1017, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:53.068997] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:53.069052] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:53.069096] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276592272369, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1883, last_round_trip_time:1071, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:53.069131] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:53.154673] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F18] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:53.155494] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F19] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:53.156515] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F1A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:53.157286] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F1B] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:53.158070] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F1C] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:53.158844] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F1D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:53.159665] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F1E] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:53.306087] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:53.306097] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:53.306109] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=191) [2024-01-03 18:09:53.306118] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:53.306125] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:53.306133] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=783487746) [2024-01-03 18:09:53.306165] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:53.306173] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E1A5] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:53.306213] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E1A6] [lt=12] [dc=0] start to process rs list update task [2024-01-03 18:09:53.306450] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E1A6] [lt=33] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:53.573047] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854B] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:53.573088] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854B] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:53.573106] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854B] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:53.573130] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854B] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:09:53.746259] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E199] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:53.746304] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E199] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:53.746319] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E199] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:53.746347] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E199] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:53.746406] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1D6] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:53.746492] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E199] [lt=51] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:53.746507] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E199] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:53.786182] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1D6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:53.786226] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1D6] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:53.786236] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1D6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:53.786260] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1D6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:53.786334] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E17B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:53.786428] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1D6] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:53.786472] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1D6] [lt=32] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:53.821914] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E17B] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:53.821968] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E17B] [lt=51] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:53.821979] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E17B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:53.822003] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E17B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:53.822097] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E17B] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:53.822111] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E17B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:54.011622] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:54.011639] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:54.011658] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:54.072370] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:54.072409] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:54.072436] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276593573015, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-701, last_round_trip_time:1028, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:54.072453] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:54.072470] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276592272369, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1883, last_round_trip_time:1071, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:54.072487] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:54.273537] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DB] [lt=32] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:54.273558] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DB] [lt=19] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:54.273565] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DB] [lt=5] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:54.273578] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DB] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=69, ddl_arg=NULL) [2024-01-03 18:09:54.388623] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428477] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:09:54.493406] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528FFE] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.494160] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528FFF] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=38, ddl_arg=NULL) [2024-01-03 18:09:54.495012] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529000] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.495536] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529001] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:54.496107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529002] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.496731] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529003] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:54.497175] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529004] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.669357] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF0] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:54.669383] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF0] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:54.669391] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF0] [lt=6] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:54.669404] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF0] [lt=5] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=86, ddl_arg=NULL) [2024-01-03 18:09:54.746657] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E17C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:54.776940] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E17C] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:54.777012] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E17C] [lt=68] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:54.777032] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E17C] [lt=18] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:54.777071] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E17C] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:54.777224] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E17C] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:54.777242] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E17C] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:54.786633] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1A9] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:54.815204] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1A9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:54.815221] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1A9] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:54.815230] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1A9] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:54.815254] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1A9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:54.815358] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1A9] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:54.815372] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1A9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:54.822272] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E19C] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:54.851529] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E19C] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:54.851569] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E19C] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:54.851582] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E19C] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:54.851622] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E19C] [lt=16] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:54.851763] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E19C] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:54.851777] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E19C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:54.937834] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=47] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:54.937898] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=41] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:54.937914] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:54.939119] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E279] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.939996] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27A] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.940721] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:54.941322] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27C] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:55.001702] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB23] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:09:55.013387] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:55.013424] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:55.013433] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:55.075066] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:55.075085] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:55.075116] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276593573015, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-701, last_round_trip_time:1028, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:55.075126] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276594273513, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1879, last_round_trip_time:1049, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:55.075129] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:55.075138] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:55.160780] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F20] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:55.161598] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F21] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:55.162516] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F22] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:55.163574] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F23] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:55.164276] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F24] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:55.164927] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F25] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:55.165678] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF2-00060E079EC94F26] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:55.574346] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854C] [lt=5] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:55.574398] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854C] [lt=47] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:55.574415] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854C] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:55.574439] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854C] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=128, ddl_arg=NULL) [2024-01-03 18:09:55.733559] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FD] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:55.777458] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E19D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:55.807366] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E19D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:55.807383] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E19D] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:55.807392] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E19D] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:55.807415] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E19D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:55.807513] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E19D] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:55.807527] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E19D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:55.815556] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1DB] [lt=4] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:55.848061] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1DB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:55.848101] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1DB] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:55.848117] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1DB] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:55.848153] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1DB] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:55.848300] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1DB] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:55.848313] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1DB] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:55.851925] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E17F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:55.881155] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E17F] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:55.881191] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E17F] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:55.881201] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E17F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:55.881226] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E17F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:55.881368] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E17F] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:55.881388] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E17F] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:56.015941] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:56.016012] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=61] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:56.016027] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:56.077926] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:56.078025] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:56.078029] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276594273513, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1879, last_round_trip_time:1049, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:56.078049] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:56.078068] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276595574313, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-723, last_round_trip_time:1034, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:56.078081] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:56.274645] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DC] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:56.274698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DC] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:56.274716] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DC] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:56.274739] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DC] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:09:56.498283] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529005] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.499421] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529006] [lt=87] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:09:56.500933] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529007] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.501788] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529008] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:09:56.502364] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529009] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.503067] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52900A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:56.503780] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF1-00060E079C52900B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.670221] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF1] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:56.670263] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF1] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:56.670284] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF1] [lt=16] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:56.670307] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF1] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:09:56.807726] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E180] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:56.838608] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E180] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:56.838651] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E180] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:56.838667] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E180] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:56.838700] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E180] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:56.838805] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E180] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:56.838818] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E180] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:56.848455] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1AE] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:56.879171] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1AE] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:56.879216] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1AE] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:56.879235] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1AE] [lt=17] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:56.879267] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1AE] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:56.879396] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1AE] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:56.879415] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1AE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:56.881497] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1DE] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:56.913116] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1DE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:56.913156] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1DE] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:56.913166] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1DE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:56.913195] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1DE] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:56.913297] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1DE] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:56.913310] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1DE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:56.913332] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:09:56.913350] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:09:56.913444] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=34] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:09:56.914301] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:09:56.914527] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:09:56.915581] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:56.915593] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:56.915767] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:09:56.916621] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:09:56.916628] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:09:56.916812] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:09:56.916835] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:09:56.916843] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:09:56.916966] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:09:56.916989] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=21] [dc=0] broadcast root address succeed [2024-01-03 18:09:56.918368] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:09:56.918429] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:56.918440] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:09:56.920934] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:09:56.922489] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:09:56.942326] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27D] [lt=72] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.942874] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27E] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.943440] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E27F] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:56.944162] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E280] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:57.018450] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:57.018463] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:57.018473] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:57.081014] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:57.081067] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276596274612, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1731, last_round_trip_time:1023, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:57.081080] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:57.081148] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:57.081192] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276595574313, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-723, last_round_trip_time:1034, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:57.081227] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:57.166835] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F27] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:57.167787] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F28] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:09:57.168677] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F29] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:57.169379] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F2A] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:57.170003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F2B] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:57.170654] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F2C] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:57.171419] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F2D] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:57.179702] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=30] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:09:57.179739] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=30] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:09:57.444044] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:57.444060] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=9] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:09:57.444077] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=9] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=192) [2024-01-03 18:09:57.444090] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:09:57.444103] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=10] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:09:57.444115] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=8] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=787625726) [2024-01-03 18:09:57.444152] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=9] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:09:57.444168] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E1E0] [lt=14] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:09:57.444200] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E1E1] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:09:57.444349] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E1E1] [lt=9] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:09:57.575787] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854D] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:57.575827] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:57.575838] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:57.575855] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:09:57.839018] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1A2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:57.872172] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1A2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:57.872212] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1A2] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:57.872234] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1A2] [lt=20] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:57.872258] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1A2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:57.872377] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1A2] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:57.872396] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1A2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:57.879604] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E183] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:57.917318] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E183] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:57.917356] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E183] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:57.917366] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E183] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:57.917390] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E183] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:57.917475] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1B1] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:57.917557] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E183] [lt=70] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:57.917572] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E183] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:57.947862] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1B1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:57.947900] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1B1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:57.947910] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1B1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:57.947934] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1B1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:57.948057] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1B1] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:57.948074] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1B1] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:58.021601] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:58.021627] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:58.021642] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:58.084107] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:58.084189] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276596274612, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1731, last_round_trip_time:1023, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:58.084258] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=60] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:58.084306] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=90] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:58.084350] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276597575756, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-513, last_round_trip_time:1034, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:58.084400] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=45] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:58.275834] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DD] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:58.275874] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DD] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:58.275887] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DD] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:58.275904] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DD] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=108, ddl_arg=NULL) [2024-01-03 18:09:58.637580] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52900D] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.638505] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52900E] [lt=73] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:09:58.639239] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52900F] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.639925] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529010] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:58.640560] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529011] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.641241] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529012] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:09:58.642188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529013] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.671171] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF2] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:58.671208] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF2] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:58.671220] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF2] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:58.671260] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF2] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:09:58.872562] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1B2] [lt=53] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:58.904191] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1B2] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:58.904229] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1B2] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:58.904239] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1B2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:58.904263] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1B2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:58.904382] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1B2] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:58.904396] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1B2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:58.917750] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1E4] [lt=50] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:58.945408] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E281] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.946037] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E282] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.946535] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E283] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.947327] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E284] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:58.950793] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1E4] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:58.950815] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1E4] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:58.950829] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1E4] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:58.950862] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1E4] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:58.951035] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1E4] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:58.951053] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1E4] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:58.951204] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1A5] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:58.986035] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1A5] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:58.986086] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1A5] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:58.986097] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1A5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:58.986125] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1A5] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:58.986224] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1A5] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:58.986237] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1A5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:59.024590] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:09:59.024620] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:09:59.024630] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:09:59.087139] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:59.087191] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276597575756, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-513, last_round_trip_time:1034, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:59.087204] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:09:59.087411] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:09:59.087464] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276598275801, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1850, last_round_trip_time:1026, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:09:59.087504] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:09:59.311580] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F2F] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:59.312319] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F30] [lt=91] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:09:59.313107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F31] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:59.314029] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F32] [lt=58] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:09:59.314916] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F33] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:59.315691] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F34] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:09:59.316265] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F35] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:09:59.389814] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428478] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:09:59.577113] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854E] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:09:59.577186] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854E] [lt=69] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:09:59.577197] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:09:59.577215] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854E] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=138, ddl_arg=NULL) [2024-01-03 18:09:59.904545] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1A6] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:59.937791] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1A6] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:59.937829] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1A6] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:59.937838] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1A6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:59.937872] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1A6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:59.938040] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1A6] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:59.938055] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1A6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:59.939899] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:59.939934] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=16] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:59.940035] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=75] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:09:59.951178] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E188] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:09:59.984925] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E188] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:09:59.984977] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E188] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:09:59.984988] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E188] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:09:59.985011] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E188] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:09:59.985108] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E188] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:09:59.985122] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E188] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:09:59.986418] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1E7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:00.002558] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB24] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:00.024186] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1E7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:00.024225] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1E7] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:00.024238] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1E7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:00.024271] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1E7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:00.024413] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1E7] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:00.024432] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1E7] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:00.027448] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:00.027492] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:00.027510] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:00.090099] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:00.090274] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=116] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276599577081, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:1017, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:00.090325] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=44] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:00.090347] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=63] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:00.090392] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276598275801, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1850, last_round_trip_time:1026, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:00.090405] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:00.277096] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DE] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:00.277135] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DE] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:00.277163] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:00.277193] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DE] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=163, ddl_arg=NULL) [2024-01-03 18:10:00.643908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529014] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.644896] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529015] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:10:00.645654] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529016] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.646404] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529017] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:00.647279] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529018] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.648005] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529019] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:00.648717] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52901A] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.672076] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF3] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:00.672131] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF3] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:00.672150] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF3] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:00.672175] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF3] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=147, ddl_arg=NULL) [2024-01-03 18:10:00.734469] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FE] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:00.938226] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1E8] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:00.948383] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E286] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.949193] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E287] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.950113] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF0-00060E079A34E288] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.950679] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E289] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:00.969357] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1E8] [lt=33] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:00.969402] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1E8] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:00.969419] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1E8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:00.969455] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1E8] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:00.969841] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1E8] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:00.969865] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1E8] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:00.985276] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1B7] [lt=63] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:01.017263] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1B7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:01.017309] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1B7] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:01.017325] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1B7] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:01.017358] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1B7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:01.017497] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1B7] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:01.017515] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1B7] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:01.024627] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1A9] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:01.030670] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:01.030757] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=73] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:01.030774] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:01.030804] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=10] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:01.030819] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:01.030895] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=34] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:01.031705] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=13] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:01.031928] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:01.033229] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=36] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:01.033241] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:01.033641] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=29] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:01.034770] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:01.034779] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:01.034986] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:01.034996] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=8] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:01.035005] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:10:01.035103] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:01.035142] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=37] [dc=0] broadcast root address succeed [2024-01-03 18:10:01.036629] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:01.036686] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:01.036697] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:01.039201] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:01.040912] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=54] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:01.055278] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1A9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:01.055315] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1A9] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:01.055326] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1A9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:01.055350] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1A9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:01.055439] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1A9] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:01.055453] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1A9] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:01.093081] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:01.093133] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276600277055, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1734, last_round_trip_time:1024, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:01.093147] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:01.093321] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:01.093385] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276599577081, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:1017, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:01.093416] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:01.302218] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=7] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:01.302236] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=9] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:01.317242] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F36] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:01.318219] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F37] [lt=18] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:10:01.318922] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F38] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:01.319708] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F39] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:01.320558] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F3A] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:01.321204] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F3B] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:01.321812] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F3C] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:01.570665] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:01.570676] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:01.570691] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=193) [2024-01-03 18:10:01.570708] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=15] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:01.570722] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=11] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:01.570735] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=10] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=791752346) [2024-01-03 18:10:01.570780] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=19] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:01.570800] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E18E] [lt=17] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:01.570846] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E18F] [lt=13] [dc=0] start to process rs list update task [2024-01-03 18:10:01.571084] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E18F] [lt=34] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:01.578392] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42854F] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:01.578434] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42854F] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:01.578447] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42854F] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:01.578463] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42854F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:10:01.970042] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1AA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:02.004728] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1AA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:02.004772] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1AA] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:02.004786] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1AA] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:02.004829] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1AA] [lt=18] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:02.005002] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1AA] [lt=56] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:02.005021] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1AA] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:02.017697] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1BA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:02.033240] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:02.033270] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:02.033279] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:02.048072] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1BA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:02.048111] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1BA] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:02.048121] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1BA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:02.048145] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1BA] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:02.048238] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1BA] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:02.048252] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1BA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:02.055596] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E190] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:02.086720] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E190] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:02.086769] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E190] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:02.086780] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E190] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:02.086805] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E190] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:02.086992] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E190] [lt=72] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:02.087018] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E190] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:02.095312] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:02.095357] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276600277055, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1734, last_round_trip_time:1024, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:02.095389] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:02.096481] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:02.096541] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276601578352, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-583, last_round_trip_time:1037, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:02.096622] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=75] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:02.278351] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944DF] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:02.278413] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944DF] [lt=59] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:02.278426] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944DF] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:02.278443] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944DF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=141, ddl_arg=NULL) [2024-01-03 18:10:02.650235] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52901B] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.651227] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52901C] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:02.652015] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52901D] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.652838] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52901E] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:02.653813] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52901F] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.654689] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529020] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:02.655434] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF1-00060E079C529021] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.672914] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF4] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:02.672970] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF4] [lt=52] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:02.672982] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF4] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:02.672999] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:10:02.951594] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E28A] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.952247] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E28B] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.952778] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E28C] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:02.953485] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E28D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:03.005190] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1BB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:03.035874] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:03.035917] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:03.035932] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:03.039774] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1BB] [lt=82] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:03.039806] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1BB] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:03.039816] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1BB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:03.039840] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1BB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:03.039941] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1BB] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:03.039974] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1BB] [lt=26] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:03.048409] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1AD] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:03.079190] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1AD] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:03.079227] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1AD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:03.079237] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1AD] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:03.079260] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1AD] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:03.079361] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1AD] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:03.079375] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1AD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:03.087149] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1EF] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:03.098218] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:03.098269] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276602278318, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1811, last_round_trip_time:1006, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:03.098296] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:03.099440] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:03.099494] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276601578352, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-583, last_round_trip_time:1037, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:03.099514] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:03.117820] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1EF] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:03.117860] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1EF] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:03.117874] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1EF] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:03.117909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1EF] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:03.118115] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1EF] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:03.118135] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1EF] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:03.323036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94F3D] [lt=66] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:03.324078] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F3E] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:10:03.325178] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F3F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:03.326116] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F40] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:03.326864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F41] [lt=85] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:03.327570] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF2-00060E079EC94F42] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:03.328318] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F43] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:03.579549] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428550] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:03.579590] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428550] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:03.579607] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428550] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:03.579630] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428550] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=115, ddl_arg=NULL) [2024-01-03 18:10:04.038914] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:04.038974] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:04.038991] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:04.040138] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E195] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:04.070703] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E195] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:04.070751] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E195] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:04.070764] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E195] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:04.070802] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E195] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:04.070999] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E195] [lt=98] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:04.071023] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E195] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:04.079548] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1BE] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:04.101610] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:04.101696] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276602278318, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1811, last_round_trip_time:1006, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:04.101710] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:04.102770] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:04.102862] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276603579518, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-769, last_round_trip_time:1058, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:04.102935] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=68] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:04.111274] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1BE] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:04.111293] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1BE] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:04.111302] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1BE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:04.111327] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1BE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:04.111422] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1BE] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:04.111442] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1BE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:04.118270] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E196] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:04.148555] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E196] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:04.148590] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E196] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:04.148600] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E196] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:04.148624] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E196] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:04.148739] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E196] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:04.148760] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E196] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:04.279357] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E0] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:04.279398] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E0] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:04.279410] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:04.279427] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E0] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:10:04.390765] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428479] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:04.656628] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF1-00060E079C529023] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:04.657524] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529024] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:10:04.658396] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2007][462][YB42C0A86EF1-00060E079C529025] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:04.659072] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529026] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:04.659817] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529027] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:04.660530] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529028] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:04.661282] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529029] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:04.673917] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF5] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:04.673993] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF5] [lt=70] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:04.674010] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF5] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:04.674033] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF5] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=149, ddl_arg=NULL) [2024-01-03 18:10:05.003313] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB25] [lt=18] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:05.042042] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=50] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:05.042064] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:05.042076] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:05.071271] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1B2] [lt=29] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:05.103819] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1B2] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:05.103868] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1B2] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:05.103884] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1B2] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:05.103917] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1B2] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:05.104173] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:05.104206] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=14] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:05.104179] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1B2] [lt=132] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:05.104234] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=10] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:05.104254] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1B2] [lt=64] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:05.105110] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:05.105158] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276604279325, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1912, last_round_trip_time:1013, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:05.105170] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:05.105191] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:05.105199] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF0-00060E079A34E28F] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:05.105207] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:05.105278] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=13] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:05.105749] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:05.105789] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276603579518, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-769, last_round_trip_time:1058, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:05.105800] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:05.105869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E290] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:05.105966] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=20] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:05.106203] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=48] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:05.106440] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E291] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:05.106973] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E292] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:05.107264] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:05.107273] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:05.107488] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:05.108543] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:05.108555] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:05.108778] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:05.108802] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:05.108810] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:05.108942] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=30] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:05.108992] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=48] [dc=0] broadcast root address succeed [2024-01-03 18:10:05.110303] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:05.110354] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=34] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:05.110366] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:05.111613] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1F4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:05.113097] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:05.114813] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:05.144275] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1F4] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:05.144301] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1F4] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:05.144315] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1F4] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:05.144346] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1F4] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:05.144452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1F4] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:05.144471] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1F4] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:05.148912] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1B3] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:05.179328] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1B3] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:05.179375] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1B3] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:05.179386] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1B3] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:05.179411] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1B3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:05.179581] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1B3] [lt=40] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:05.179605] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1B3] [lt=16] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:05.333618] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F4A] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:05.334379] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F4B] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:05.376597] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:05.376623] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=18] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:05.580816] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428551] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:05.580892] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428551] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:05.653930] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=7] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:05.653940] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:05.653973] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=26] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=194) [2024-01-03 18:10:05.653982] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:05.653990] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:05.653998] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=795835610) [2024-01-03 18:10:05.654027] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:05.654048] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E1C2] [lt=18] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:05.735342] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943FF] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:06.044787] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:06.044835] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:06.044851] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:06.044883] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E19B] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:10:06.045042] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E19B] [lt=9] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:06.104413] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1F5] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:06.108155] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:06.108211] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276604279325, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1912, last_round_trip_time:1013, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:06.108278] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=59] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:06.109308] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:06.109369] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276605580769, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-635, last_round_trip_time:1041, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:06.109404] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:06.136471] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1F5] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:06.136506] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1F5] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:06.136516] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1F5] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:06.136540] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1F5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:06.136619] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1F5] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:06.136632] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1F5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:06.144653] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E19C] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:06.175410] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E19C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:06.175449] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E19C] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:06.175467] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E19C] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:06.175500] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E19C] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:06.175641] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E19C] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:06.175662] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E19C] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:06.179780] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1B6] [lt=44] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:06.210635] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1B6] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:06.210671] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1B6] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:06.210681] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1B6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:06.210705] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1B6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:06.210804] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1B6] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:06.210826] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1B6] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:06.280686] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E1] [lt=17] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:06.280724] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E1] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:06.280735] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:06.280753] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:10:06.662300] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF1-00060E079C52902A] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:06.663352] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52902B] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:10:06.664237] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52902C] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:06.664859] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52902D] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:06.665520] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52902E] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:06.666259] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52902F] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:06.666995] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529030] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:06.675037] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:06.675134] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF6] [lt=91] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:06.675156] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF6] [lt=18] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:06.675184] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF6] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=251, ddl_arg=NULL) [2024-01-03 18:10:07.047909] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=54] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:07.047968] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:07.047979] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:07.107812] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E293] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.108355] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2011][470][YB42C0A86EF0-00060E079A34E294] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.108996] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E295] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.109520] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E296] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.111189] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=162] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:07.111292] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276606280656, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1783, last_round_trip_time:1009, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:07.111309] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:07.112296] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:07.112361] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276605580769, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-635, last_round_trip_time:1041, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:07.112393] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:07.136840] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1B7] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:07.169553] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1B7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:07.169590] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1B7] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:07.169601] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1B7] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:07.169626] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1B7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:07.169723] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1B7] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:07.169737] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1B7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:07.175832] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1C7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:07.207047] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1C7] [lt=31] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:07.207104] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1C7] [lt=54] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:07.207114] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1C7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:07.207139] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1C7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:07.207259] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1C7] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:07.207280] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1C7] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:07.210993] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1F8] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:07.241750] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1F8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:07.241778] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1F8] [lt=27] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:07.241788] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1F8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:07.241812] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1F8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:07.241917] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1F8] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:07.241936] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1F8] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:07.335629] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F4C] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.336500] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F4D] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:07.337438] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F4E] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.338827] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F4F] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:07.339622] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F50] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.340647] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F51] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:10:07.341535] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F52] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:07.582228] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428552] [lt=41] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:07.582266] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428552] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:07.582278] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428552] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:07.582295] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428552] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:10:08.050800] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:08.050813] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:08.050823] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:08.113687] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:08.113739] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276606280656, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1783, last_round_trip_time:1009, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:08.113751] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:08.115934] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:08.116012] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276607582196, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-712, last_round_trip_time:1026, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:08.116029] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:08.169925] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1F9] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:08.204919] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1F9] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:08.204938] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1F9] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:08.204967] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1F9] [lt=27] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:08.204993] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1F9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:08.205090] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1F9] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:08.205104] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1F9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:08.207440] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1A1] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:08.238379] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1A1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:08.238419] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1A1] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:08.238429] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1A1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:08.238453] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1A1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:08.238555] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1A1] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:08.238568] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1A1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:08.242207] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1BA] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:08.275558] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1BA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:08.275577] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1BA] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:08.275586] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1BA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:08.275612] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1BA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:08.275740] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1BA] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:08.275754] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1BA] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:08.281748] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E2] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:08.281786] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E2] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:08.281798] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E2] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:08.281815] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E2] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:10:08.676272] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF7] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:08.676309] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF7] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:08.676321] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF7] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:08.676339] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF7] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:10:08.808454] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529032] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:08.809211] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529033] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:10:08.810013] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2014][476][YB42C0A86EF1-00060E079C529034] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:08.810745] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529035] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:08.811449] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529036] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:08.812266] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529037] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:08.813281] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529038] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.053508] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:09.053537] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:09.053546] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:09.110406] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF0-00060E079A34E297] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.111199] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E298] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.111820] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E299] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.112455] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E29A] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.116715] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:09.116766] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276608281716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1884, last_round_trip_time:962, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:09.116779] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:09.119137] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:09.119180] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276607582196, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-712, last_round_trip_time:1026, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:09.119192] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:09.119212] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:09.119225] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:09.119278] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=23] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:09.119909] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:09.120226] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=35] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:09.121460] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=18] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:09.121472] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:09.121738] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:09.122905] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:09.122912] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:09.123189] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=68] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:09.123213] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:09.123222] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:09.123347] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=42] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:09.123368] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:10:09.125057] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:09.125157] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=81] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:09.125172] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:09.128323] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=15] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:09.129767] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:09.205592] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1BB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:09.239944] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1BB] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:09.239987] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1BB] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:09.239997] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1BB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:09.240021] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1BB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:09.240093] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1CC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:09.240151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1BB] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:09.240172] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1BB] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:09.272150] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1CC] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:09.272195] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1CC] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:09.272210] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1CC] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:09.272245] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1CC] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:09.272407] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1CC] [lt=68] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:09.272423] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1CC] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:09.275893] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E1FC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:09.308272] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E1FC] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:09.308290] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E1FC] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:09.308299] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E1FC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:09.308324] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E1FC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:09.308442] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E1FC] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:09.308461] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E1FC] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:09.390155] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:09.390178] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=17] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:09.391771] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42847A] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:09.483375] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F54] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.484230] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F55] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:10:09.485008] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2003][454][YB42C0A86EF2-00060E079EC94F56] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.485765] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F57] [lt=52] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:09.486691] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F58] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.487319] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F59] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:09.487842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F5A] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:09.583516] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428553] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:09.583570] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428553] [lt=51] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:09.583582] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428553] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:09.583600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428553] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:10:09.661922] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:09.661938] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:09.661972] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=28] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=195) [2024-01-03 18:10:09.661982] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=9] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:09.661990] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:09.661998] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=799843610) [2024-01-03 18:10:09.662027] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:09.662035] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E1A5] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:09.662065] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E1A6] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:10:09.662202] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E1A6] [lt=12] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:10.003925] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB26] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:10.056130] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:10.056175] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:10.056190] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:10.105715] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:10.105806] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:10.105825] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:10.119456] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:10.119515] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276608281716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1884, last_round_trip_time:962, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:10.119548] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:10.122721] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:10.122763] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276609583484, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-666, last_round_trip_time:1018, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:10.122797] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:10.240331] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1A7] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:10.274803] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1A7] [lt=99] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:10.274854] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1A7] [lt=47] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:10.274870] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1A7] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:10.274900] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1A7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:10.274978] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1BE] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:10.275042] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1A7] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:10.275054] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1A7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:10.283088] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:10.283133] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E3] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:10.283148] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E3] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:10.283185] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E3] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=174, ddl_arg=NULL) [2024-01-03 18:10:10.309106] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1BE] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:10.309145] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1BE] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:10.309155] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1BE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:10.309179] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1BE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:10.309253] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1CF] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:10.309307] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1BE] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:10.309327] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1BE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:10.341195] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1CF] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:10.341235] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1CF] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:10.341244] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1CF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:10.341269] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1CF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:10.341378] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1CF] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:10.341401] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1CF] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:10.677307] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF8] [lt=18] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:10.677363] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF8] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:10.677380] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF8] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:10.677407] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF8] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=142, ddl_arg=NULL) [2024-01-03 18:10:10.736298] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94400] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:10.814385] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529039] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:10.815277] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52903A] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:10:10.816003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52903B] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:10.816602] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52903C] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:10.819571] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF1-00060E079C52903D] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:10.820397] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52903E] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:10.821221] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52903F] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.059020] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=52] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:11.059050] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:11.059059] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:11.113464] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E29C] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.114051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E29D] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.114593] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E29E] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.115391] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E29F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.123869] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:11.123987] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276610283015, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1669, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:11.124029] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:11.126268] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:11.126333] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276609583484, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-666, last_round_trip_time:1018, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:11.126369] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:11.275222] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1D0] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:11.306918] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1D0] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:11.306976] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1D0] [lt=55] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:11.306988] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1D0] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:11.307012] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1D0] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:11.307151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1D0] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:11.307165] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1D0] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:11.309444] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E201] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:11.340808] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E201] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:11.340844] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E201] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:11.340858] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E201] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:11.340882] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E201] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:11.341003] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E201] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:11.341017] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E201] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:11.341574] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1AA] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:11.373299] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1AA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:11.373337] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1AA] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:11.373348] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1AA] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:11.373373] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1AA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:11.373476] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1AA] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:11.373493] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1AA] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:11.488783] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F5B] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.489636] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F5C] [lt=79] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:11.490499] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F5D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.491333] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F5E] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:11.492149] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F5F] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.492811] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F60] [lt=96] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:11.493516] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F61] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:11.584662] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428554] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:11.584700] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428554] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:11.584711] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428554] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:11.584729] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428554] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:10:12.061729] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:12.061743] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:12.061753] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:12.127432] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:12.127535] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=45] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276610283015, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1669, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:12.127556] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:12.129379] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:12.129422] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276611584630, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-769, last_round_trip_time:1006, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:12.129461] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:12.284515] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:12.284552] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E4] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:12.284563] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:12.284581] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:10:12.307312] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1AB] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:12.335459] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1AB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:12.335495] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1AB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:12.335505] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1AB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:12.335527] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1AB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:12.335625] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1AB] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:12.335638] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1AB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:12.341150] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1C3] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:12.370517] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1C3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:12.370555] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1C3] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:12.370566] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1C3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:12.370590] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1C3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:12.370692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1C3] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:12.370710] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1C3] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:12.373666] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1D3] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:12.403645] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1D3] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:12.403662] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1D3] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:12.403671] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1D3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:12.403695] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1D3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:12.403798] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1D3] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:12.403811] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1D3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:12.678353] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBF9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:12.678415] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBF9] [lt=58] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:12.678452] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBF9] [lt=33] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:12.678539] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBF9] [lt=75] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=223, ddl_arg=NULL) [2024-01-03 18:10:12.822476] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529040] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:12.823360] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529041] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=55, ddl_arg=NULL) [2024-01-03 18:10:12.824050] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529042] [lt=74] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:12.824659] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529043] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:12.825322] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529044] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:12.826004] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529045] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:12.826536] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529046] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.064238] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:13.064267] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:13.064276] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:13.116349] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A0] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.116846] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2014][476][YB42C0A86EF0-00060E079A34E2A1] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.117351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A2] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.117791] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A3] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.130421] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:13.130497] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276612284484, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1891, last_round_trip_time:942, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:13.130546] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:13.132438] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:13.132485] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276611584630, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-769, last_round_trip_time:1006, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:13.132498] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:13.132532] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=11] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:13.132552] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:13.132653] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:13.133445] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=40] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:13.133702] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=28] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:13.134570] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:13.134578] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:13.134838] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:13.135676] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=26] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:13.135682] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:13.135902] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:13.135924] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:13.135933] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:13.136037] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:13.136070] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=32] [dc=0] broadcast root address succeed [2024-01-03 18:10:13.137426] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:13.137484] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=41] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:13.137504] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=17] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:13.139914] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:13.141662] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=19] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:13.335795] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1D4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:13.364921] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1D4] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:13.365000] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1D4] [lt=76] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:13.365011] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1D4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:13.365035] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1D4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:13.365141] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1D4] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:13.365155] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1D4] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:13.370822] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E206] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:13.393132] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:13.393143] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:13.400210] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E206] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:13.400244] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E206] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:13.400254] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E206] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:13.400282] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E206] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:13.400377] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E206] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:13.400394] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E206] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:13.403965] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1AE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:13.438830] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1AE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:13.438868] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1AE] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:13.438879] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1AE] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:13.438903] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1AE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:13.439025] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1AE] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:13.439038] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1AE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:13.494550] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F62] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.495281] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F63] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:13.495936] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F64] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.496456] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F65] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:13.497002] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F66] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.497593] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F67] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:13.498086] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F68] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:13.608287] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:13.608311] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=19] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:13.608323] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=196) [2024-01-03 18:10:13.608332] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:13.608340] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:13.608348] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=803789960) [2024-01-03 18:10:13.608373] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:13.608381] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24E1C7] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:13.608413] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24E1C8] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:10:13.608542] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24E1C8] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:14.066743] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:14.066772] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:14.066781] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:14.132926] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:14.133003] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276612284484, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1891, last_round_trip_time:942, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:14.133016] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:14.135221] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:14.135264] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276613585643, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-732, last_round_trip_time:961, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:14.135275] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:14.285480] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E5] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:14.285519] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E5] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:14.285531] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E5] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:14.285549] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E5] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:10:14.365308] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1C9] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:14.392624] INFO [RS] ob_rs_rpc_processor.h:196 [2013][474][YB42C0A86EF1-00060E079C42847B] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:14.395915] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1C9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:14.396000] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1C9] [lt=80] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:14.396015] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1C9] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:14.396072] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1C9] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:14.396240] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1C9] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:14.396263] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1C9] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:14.400532] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1D7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:14.431088] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1D7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:14.431125] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1D7] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:14.431135] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1D7] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:14.431160] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1D7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:14.431264] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1D7] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:14.431277] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1D7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:14.439197] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E209] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:14.470662] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E209] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:14.470697] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E209] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:14.470707] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E209] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:14.470730] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E209] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:14.470834] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E209] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:14.470848] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E209] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:14.679457] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFA] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:14.679496] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFA] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:14.679508] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFA] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:14.679525] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:10:14.827690] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529048] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:14.828365] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529049] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:10:14.828998] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52904A] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:14.829535] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52904B] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:14.830251] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52904C] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:14.830972] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52904D] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:10:14.831668] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52904E] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.004624] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB27] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:15.069114] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:15.069149] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:15.069162] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:15.135983] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=56] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:15.136031] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276614285447, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1866, last_round_trip_time:927, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:15.136044] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:15.137816] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=67] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:15.137879] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276613585643, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-732, last_round_trip_time:961, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:15.137898] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:15.266542] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=48] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:15.266636] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=50] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:15.266699] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:15.267631] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A5] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.268159] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A6] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.268722] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A7] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.269144] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A8] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.396450] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E20A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:15.424252] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E20A] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:15.424287] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E20A] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:15.424297] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E20A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:15.424321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E20A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:15.424421] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E20A] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:15.424434] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E20A] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:15.431416] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1B3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:15.461536] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1B3] [lt=22] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:15.461575] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1B3] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:15.461585] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1B3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:15.461608] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1B3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:15.461712] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1B3] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:15.461726] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1B3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:15.471026] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1CC] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:15.499096] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F6A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.500110] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F6B] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:10:15.500820] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F6C] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.501476] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F6D] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:15.501942] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F6E] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.502532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F6F] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:15.503065] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94F70] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:15.508155] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1CC] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:15.508200] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1CC] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:15.508214] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1CC] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:15.508247] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1CC] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:15.508392] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1CC] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:15.508411] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1CC] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:15.586606] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428556] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:15.586643] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428556] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:15.586679] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428556] [lt=32] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:15.586706] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428556] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:10:15.737270] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94401] [lt=93] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:16.071533] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:16.071561] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:16.071571] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:16.138511] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:16.138587] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276614285447, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1866, last_round_trip_time:927, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:16.138617] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:16.140181] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:16.140223] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276615586575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-715, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:16.140235] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:16.286440] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E6] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:16.286480] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E6] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:16.286492] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E6] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:16.286509] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:10:16.424601] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1CD] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:16.457070] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1CD] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:16.457118] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1CD] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:16.457133] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1CD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:16.457159] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1CD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:16.457287] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1CD] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:16.457301] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1CD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:16.461865] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1DC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:16.494908] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1DC] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:16.495021] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1DC] [lt=107] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:16.495038] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1DC] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:16.495072] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1DC] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:16.495238] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1DC] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:16.495262] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1DC] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:16.508630] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E20D] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:16.541701] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E20D] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:16.541719] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E20D] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:16.541730] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E20D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:16.541755] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E20D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:16.541882] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E20D] [lt=44] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:16.541896] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E20D] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:16.680446] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFB] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:16.680487] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFB] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:16.680498] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:16.680524] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFB] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:10:16.833053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52904F] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:16.834186] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529050] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=27, ddl_arg=NULL) [2024-01-03 18:10:16.835059] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529051] [lt=83] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:16.835856] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529052] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:16.836650] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529053] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:16.837408] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529054] [lt=70] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:10:16.838200] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529055] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.074073] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:17.074118] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:17.074130] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:17.141926] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:17.142015] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276616286408, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1888, last_round_trip_time:928, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:17.142114] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=93] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:17.142900] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:17.142942] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276615586575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-715, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:17.142999] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=51] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:17.143032] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=14] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:17.143051] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:17.143106] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=15] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:17.144017] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=30] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:17.144306] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=33] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:17.145576] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:17.145583] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:17.145847] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:17.146898] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:17.146910] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:17.147179] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=25] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:17.147196] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=15] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:17.147205] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:17.147384] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=17] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:17.147419] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=32] [dc=0] broadcast root address succeed [2024-01-03 18:10:17.148989] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:17.149044] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:17.149055] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:17.151517] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:17.153049] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=49] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:17.270069] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2A9] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.270541] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2AA] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.271038] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2AB] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.271639] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2AC] [lt=72] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.416373] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:17.416403] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=23] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:17.457599] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E20E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:17.486280] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E20E] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:17.486320] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E20E] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:17.486334] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E20E] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:17.486367] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E20E] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:17.486521] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E20E] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:17.486594] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E20E] [lt=63] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:17.495461] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1B8] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:17.504252] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF2-00060E079EC94F71] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.505215] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F72] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:10:17.506273] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F73] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.507273] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F74] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:17.508274] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F75] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.509100] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F76] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:17.509754] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F77] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:17.524438] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1B8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:17.524474] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1B8] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:17.524483] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1B8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:17.524507] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1B8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:17.524593] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1B8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:17.524606] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1B8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:17.542088] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1D0] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:17.573759] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1D0] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:17.573794] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1D0] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:17.573804] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1D0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:17.573828] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1D0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:17.573921] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1D0] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:17.573935] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1D0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:17.587909] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428557] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:17.587963] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428557] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:17.587975] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428557] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:17.587991] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428557] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:10:17.715686] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:17.715696] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:17.715710] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=8] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=197) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:10:17.715770] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=58] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:17.715778] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=7] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:17.715786] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=807897398) [2024-01-03 18:10:17.715816] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:17.715825] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E1E0] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:17.715862] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E1E1] [lt=15] [dc=0] start to process rs list update task [2024-01-03 18:10:17.716070] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E1E1] [lt=26] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:18.076216] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:18.076232] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:18.076239] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:18.144803] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:18.144843] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276617587878, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-520, last_round_trip_time:926, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:18.144852] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:18.144879] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:18.144922] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276616286408, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1888, last_round_trip_time:928, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:18.144934] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:18.287821] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E7] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:18.287857] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E7] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:18.287904] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E7] [lt=43] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:18.287929] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E7] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:10:18.486782] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1E2] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:18.517751] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1E2] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:18.517784] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1E2] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:18.517794] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1E2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:18.517818] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1E2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:18.517916] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1E2] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:18.517936] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1E2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:18.524753] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E211] [lt=5] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:18.556085] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E211] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:18.556118] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E211] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:18.556128] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E211] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:18.556153] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E211] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:18.556257] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E211] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:18.556277] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E211] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:18.574094] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1D3] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:18.604846] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1D3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:18.604888] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1D3] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:18.604902] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1D3] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:18.604934] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1D3] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:18.605089] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1D3] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:18.605107] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1D3] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:18.681518] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFC] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:18.681561] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFC] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:18.681573] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:18.681617] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFC] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=117, ddl_arg=NULL) [2024-01-03 18:10:18.977437] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529057] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:18.978231] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529058] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:10:18.979088] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529059] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:18.979880] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52905A] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:18.980521] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52905B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:18.981288] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52905C] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:18.981984] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52905D] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.079028] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:19.079058] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:19.079068] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:19.147264] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:19.147315] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276617587878, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-520, last_round_trip_time:926, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:19.147328] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:19.147626] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:19.147683] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276618287780, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1705, last_round_trip_time:908, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:19.147720] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:19.272581] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E2AD] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.273282] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2AE] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.273886] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2AF] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.274555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B0] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.393632] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42847C] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:19.518158] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1D4] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:19.553909] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1D4] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:19.553932] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1D4] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:19.553944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1D4] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:19.553988] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1D4] [lt=26] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:19.554085] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1D4] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:19.554099] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1D4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:19.556478] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1BD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:19.585247] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1BD] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:19.585283] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1BD] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:19.585293] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1BD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:19.585322] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1BD] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:19.585412] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1BD] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:19.585425] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1BD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:19.589079] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428558] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:19.589127] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428558] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:19.589144] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428558] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:19.589168] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428558] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=158, ddl_arg=NULL) [2024-01-03 18:10:19.605300] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1E5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:19.639242] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F79] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.640002] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F7A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=54, ddl_arg=NULL) [2024-01-03 18:10:19.640413] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1E5] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:19.640448] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1E5] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:19.640465] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1E5] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:19.640491] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1E5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:19.640666] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1E5] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:19.640689] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1E5] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:19.640819] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F7B] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.641520] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F7C] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:19.642108] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F7D] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:19.642790] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F7E] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=38, ddl_arg=NULL) [2024-01-03 18:10:19.643406] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F7F] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:20.005282] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB28] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:20.082089] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:20.082125] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:20.082142] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:20.150629] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:20.150632] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=61] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:20.150680] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276619589038, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-683, last_round_trip_time:924, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:20.150680] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276618287780, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1705, last_round_trip_time:908, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:20.150692] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:20.150693] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:20.268529] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:20.268612] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=48] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:20.268652] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=26] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:20.289384] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E8] [lt=26] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:20.289429] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E8] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:20.289447] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E8] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:20.289470] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E8] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=150, ddl_arg=NULL) [2024-01-03 18:10:20.554266] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1E6] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:20.587886] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1E6] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:20.587928] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1E6] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:20.587939] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1E6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:20.587982] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1E6] [lt=24] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:20.588057] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E216] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:20.588163] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1E6] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:20.588177] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1E6] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:20.621326] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E216] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:20.621356] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E216] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:20.621366] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E216] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:20.621390] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E216] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:20.621499] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E216] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:20.621518] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E216] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:20.640869] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1D7] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:20.670210] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1D7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:20.670246] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1D7] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:20.670260] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1D7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:20.670295] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1D7] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:20.670427] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1D7] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:20.670441] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1D7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:20.682781] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFD] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:20.682871] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFD] [lt=83] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:20.682889] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFD] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:20.682912] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFD] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=211, ddl_arg=NULL) [2024-01-03 18:10:20.738288] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94402] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:10:20.983188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52905E] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:20.984023] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52905F] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=27, ddl_arg=NULL) [2024-01-03 18:10:20.984938] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529060] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:20.985715] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529061] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:20.986613] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529062] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:20.987448] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529063] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:20.988149] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529064] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.084980] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:21.085025] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=37] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:21.085083] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=55] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:21.153609] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:21.153668] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276619589038, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-683, last_round_trip_time:924, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:21.153689] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:21.153823] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:21.153881] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276620289351, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1772, last_round_trip_time:944, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:21.153937] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=50] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:21.154001] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=11] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:21.154016] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:21.154075] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=12] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:21.155010] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:21.155282] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:21.156345] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:21.156353] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:21.156548] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:21.157600] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:21.157607] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:21.157826] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:21.157850] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:21.157859] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:21.157942] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:21.157966] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=22] [dc=0] broadcast root address succeed [2024-01-03 18:10:21.159358] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:21.159419] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=44] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:21.159430] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:21.161884] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:21.163535] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=26] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:21.275604] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B2] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.276255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B3] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.276887] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B4] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.277603] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B5] [lt=152] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.431966] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:21.431977] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:21.588313] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1D8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:21.590343] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428559] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:21.590395] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428559] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:21.590408] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428559] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:21.590426] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428559] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:10:21.618848] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1D8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:21.618885] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1D8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:21.618895] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1D8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:21.618922] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1D8] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:21.619031] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1D8] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:21.619049] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1D8] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:21.621683] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1C2] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:21.644427] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F80] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.645391] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F81] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=26, ddl_arg=NULL) [2024-01-03 18:10:21.646182] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F82] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.647036] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F83] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:21.647847] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F84] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.648692] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F85] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:21.649352] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F86] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:21.658495] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1C2] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:21.658517] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1C2] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:21.658529] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1C2] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:21.658563] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1C2] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:21.658697] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1C2] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:21.658716] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1C2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:21.702751] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E219] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:21.702819] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E219] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:21.702836] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E219] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:21.702872] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E219] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:21.703076] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E219] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:21.703097] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E219] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:21.709042] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:21.709062] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=16] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:21.709074] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=198) [2024-01-03 18:10:21.709083] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:21.709091] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:21.709098] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=811890710) [2024-01-03 18:10:21.709127] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:21.709135] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E1EA] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:21.709163] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E1EB] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:22.088054] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:22.088101] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:22.088117] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:22.156204] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:22.156259] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276621590297, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-577, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:22.156293] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:22.157484] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:22.157571] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276620289351, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1772, last_round_trip_time:944, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:22.157603] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:22.290733] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944E9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:22.290777] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944E9] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:22.290790] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944E9] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:22.290808] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944E9] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=163, ddl_arg=NULL) [2024-01-03 18:10:22.619188] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1EC] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:22.650327] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1EC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:22.650367] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1EC] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:22.650378] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1EC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:22.650402] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1EC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:22.650514] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1EC] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:22.650529] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1EC] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:22.658894] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1DB] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:22.683976] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFE] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:22.684013] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFE] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:22.684026] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFE] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:22.684044] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=144, ddl_arg=NULL) [2024-01-03 18:10:22.691587] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1DB] [lt=6] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:22.691636] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1DB] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:22.691650] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1DB] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:22.691689] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1DB] [lt=14] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:22.691835] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1DB] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:22.691856] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1DB] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:22.703363] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1C5] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:22.735936] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1C5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:22.735996] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1C5] [lt=58] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:22.736007] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1C5] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:22.736032] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1C5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:22.736152] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1C5] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:22.736165] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1C5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:22.989488] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529065] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:22.990558] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529066] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:22.991971] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529067] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:22.993022] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529068] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:22.993697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529069] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:22.994418] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52906A] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:10:22.995621] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52906B] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.090783] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:23.090797] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:23.090807] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:23.159321] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:23.159375] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276621590297, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-577, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:23.159388] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:23.160534] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:23.160576] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276622290651, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1754, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:23.160589] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:23.278576] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B6] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.279285] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B7] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.279997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2014][476][YB42C0A86EF0-00060E079A34E2B8] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.280613] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2B9] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.591522] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855A] [lt=27] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:23.591568] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855A] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:23.591584] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855A] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:23.591609] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855A] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=141, ddl_arg=NULL) [2024-01-03 18:10:23.650501] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F87] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.650671] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1C6] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:23.651642] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F88] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=26, ddl_arg=NULL) [2024-01-03 18:10:23.652476] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F89] [lt=61] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.653315] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F8A] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:23.654022] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F8B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.654717] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F8C] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:23.655551] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF2-00060E079EC94F8D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:23.682122] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1C6] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:23.682165] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1C6] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:23.682178] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1C6] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:23.682210] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1C6] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:23.682334] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1C6] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:23.682352] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1C6] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:23.692044] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E21E] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:23.724738] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E21E] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:23.724763] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E21E] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:23.724776] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E21E] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:23.724800] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E21E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:23.724977] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E21E] [lt=59] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:23.724998] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E21E] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:23.736362] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1EF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:23.769562] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1EF] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:23.769598] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1EF] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:23.769615] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1EF] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:23.769647] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1EF] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:23.769772] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1EF] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:23.769793] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1EF] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:24.093533] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:24.093563] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:24.093573] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:24.162763] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:24.162842] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276623591473, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-673, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:24.162863] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:24.163815] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:24.163870] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276622290651, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1754, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:24.163996] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=120] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:24.292142] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944EA] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:24.292218] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944EA] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:24.292232] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944EA] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:24.292256] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944EA] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=158, ddl_arg=NULL) [2024-01-03 18:10:24.394769] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42847D] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:24.682529] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1F0] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:24.685050] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DBFF] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:24.685076] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DBFF] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:24.685087] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DBFF] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:24.685105] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DBFF] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=90, ddl_arg=NULL) [2024-01-03 18:10:24.719529] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1F0] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:24.719578] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1F0] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:24.719590] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1F0] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:24.719618] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1F0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:24.719772] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1F0] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:24.719788] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1F0] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:24.725190] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1E0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:24.759583] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1E0] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:24.759621] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1E0] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:24.759631] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1E0] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:24.759664] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1E0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:24.759803] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1E0] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:24.759825] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1E0] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:24.770003] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1C9] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:24.803476] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1C9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:24.803511] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1C9] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:24.803528] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1C9] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:24.803563] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1C9] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:24.803716] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1C9] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:24.803740] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1C9] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:24.803772] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=9] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:24.803799] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=11] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:24.803880] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=16] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:24.804709] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=41] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:24.804999] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:24.806411] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=48] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:24.806494] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=80] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:24.806785] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=16] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:24.807867] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:24.807873] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:24.808060] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:24.808085] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=23] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:24.808094] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:24.808205] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=30] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:24.808226] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:10:24.809807] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:24.809867] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:24.809878] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:24.812787] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:24.814547] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=43] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:24.996859] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52906D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:24.997681] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52906E] [lt=72] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:24.998447] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52906F] [lt=73] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:24.999236] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529070] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:25.000066] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529071] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.000855] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529072] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:10:25.001584] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529073] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.006101] INFO [RS] ob_rs_rpc_processor.h:196 [2018][484][YB42C0A86EF0-00060E079A24DB29] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:25.088004] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:25.088031] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=23] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:25.096801] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:25.096831] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:25.096841] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:25.165239] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=77] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:25.165290] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276623591473, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-673, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:25.165303] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:25.166872] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:25.166931] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276624292102, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1526, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:25.166984] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=48] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:25.349344] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:25.349354] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:25.349365] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=199) [2024-01-03 18:10:25.349373] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:25.349380] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:25.349388] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=815531000) [2024-01-03 18:10:25.349424] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:25.349437] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14E1CB] [lt=11] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:25.349489] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14E1CC] [lt=21] [dc=0] start to process rs list update task [2024-01-03 18:10:25.349703] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14E1CC] [lt=31] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:25.429579] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=26] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:25.429644] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=41] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:25.429660] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:25.430608] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF0-00060E079A34E2BB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.431199] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2BC] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.431870] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2BD] [lt=55] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.432361] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2BE] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.592790] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:25.592875] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855B] [lt=81] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:25.592887] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:25.592904] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855B] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=157, ddl_arg=NULL) [2024-01-03 18:10:25.656917] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F8F] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.657823] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F90] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:10:25.658897] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F91] [lt=66] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.659639] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F92] [lt=69] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:25.660194] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F93] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.660733] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F94] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:10:25.661322] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F95] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:25.719920] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E223] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:25.739494] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94403] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:25.759311] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E223] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:25.759329] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E223] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:25.759339] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E223] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:25.759376] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E223] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:25.759527] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E223] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:25.759549] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E223] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:25.760138] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1F3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:25.792491] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1F3] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:25.792556] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1F3] [lt=59] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:25.792572] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1F3] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:25.792611] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1F3] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:25.792817] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1F3] [lt=52] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:25.792841] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1F3] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:25.803899] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1E3] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:25.837854] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1E3] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:25.837903] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1E3] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:25.837921] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1E3] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:25.837978] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1E3] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:25.838118] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1E3] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:25.838133] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1E3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:26.101568] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:26.101614] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=40] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:26.101625] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:26.168024] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:26.168075] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276625592750, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:917, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:26.168088] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:26.170202] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:26.170253] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276624292102, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1526, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:26.170337] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=79] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:26.293612] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944EB] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:26.293663] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944EB] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:26.293679] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944EB] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:26.293704] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944EB] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:10:26.686074] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC00] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:26.686123] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC00] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:26.686140] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC00] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:26.686163] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC00] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=148, ddl_arg=NULL) [2024-01-03 18:10:26.759711] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1E4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:26.790008] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1E4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:26.790045] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1E4] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:26.790055] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1E4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:26.790079] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1E4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:26.790183] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1E4] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:26.790204] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1E4] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:26.793059] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1CF] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:26.822026] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1CF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:26.822062] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1CF] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:26.822072] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1CF] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:26.822096] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1CF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:26.822230] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1CF] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:26.822249] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1CF] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:26.838281] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E226] [lt=35] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:26.871793] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E226] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:26.871831] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E226] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:26.871841] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E226] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:26.871865] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E226] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:26.871988] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E226] [lt=42] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:26.872002] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E226] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:27.002848] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529074] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.003726] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529075] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:10:27.004455] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529076] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.005160] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529077] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:27.005988] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529078] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.006697] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529079] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:27.007473] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52907A] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.104641] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:27.104659] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:27.104669] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:27.171514] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:27.171589] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276625592750, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-641, last_round_trip_time:917, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:27.171602] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:27.173201] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:27.173245] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276626293568, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1763, last_round_trip_time:991, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:27.173272] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:27.433268] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2BF] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.433786] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C0] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.434421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C1] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.435044] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C2] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.594313] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855C] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:27.594363] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855C] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:27.594375] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:27.594392] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855C] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=114, ddl_arg=NULL) [2024-01-03 18:10:27.662587] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F96] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.663864] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F97] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=35, ddl_arg=NULL) [2024-01-03 18:10:27.664752] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F98] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.665536] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F99] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:27.666332] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F9A] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.667179] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F9B] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:27.668004] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F9C] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:27.790395] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E227] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:27.822294] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E227] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:27.822343] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E227] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:27.822356] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E227] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:27.822380] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E227] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:27.822419] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1F8] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:27.822469] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E227] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:27.822482] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E227] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:27.851566] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1F8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:27.851585] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1F8] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:27.851595] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1F8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:27.851619] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1F8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:27.851739] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1F8] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:27.851760] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1F8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:27.872141] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1E7] [lt=29] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:27.904811] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1E7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:27.904848] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1E7] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:27.904858] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1E7] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:27.904883] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1E7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:27.904998] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1E7] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:27.905010] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1E7] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:28.107261] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:28.107290] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:28.107299] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:28.174532] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=46] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:28.174585] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276627594281, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-376, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:28.174691] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=97] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:28.175742] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:28.175798] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276626293568, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1763, last_round_trip_time:991, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:28.175827] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:28.295047] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944EC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:28.295142] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944EC] [lt=89] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:28.295165] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944EC] [lt=19] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:28.295221] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944EC] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=190, ddl_arg=NULL) [2024-01-03 18:10:28.687004] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC01] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:28.687051] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC01] [lt=43] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:28.687068] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC01] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:28.687090] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC01] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=153, ddl_arg=NULL) [2024-01-03 18:10:28.822646] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1E8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:28.859001] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1E8] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:28.859047] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1E8] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:28.859063] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1E8] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:28.859098] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1E8] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:28.859247] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1E8] [lt=41] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:28.859213] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1D4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:28.859268] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1E8] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:28.888999] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1D4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:28.889044] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1D4] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:28.889055] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1D4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:28.889079] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1D4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:28.889208] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1D4] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:28.889221] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1D4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:28.905204] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E22A] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:28.936166] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E22A] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:28.936204] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E22A] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:28.936215] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E22A] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:28.936239] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E22A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:28.936348] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E22A] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:28.936364] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E22A] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:28.936387] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:28.936406] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:28.936475] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=23] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:28.937345] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=31] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:28.937561] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:28.938942] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:28.938975] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=30] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:28.939205] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:28.940374] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=33] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:28.940381] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:28.940588] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=32] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:28.940635] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=42] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:28.940650] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=11] [dc=0] start to process rs list update task [2024-01-03 18:10:28.940749] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=26] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:28.940759] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=8] [dc=0] broadcast root address succeed [2024-01-03 18:10:28.942742] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:28.942817] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=50] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:28.942841] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=21] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:28.945212] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:28.946750] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:29.109681] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:29.109710] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:29.109719] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:29.143651] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52907C] [lt=125] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.144496] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52907D] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:10:29.145322] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52907E] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.146043] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52907F] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:10:29.146819] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529080] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.147461] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529081] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:29.148253] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529082] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.177654] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:29.177710] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276627594281, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-376, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:29.177729] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:29.178729] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:29.178794] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276628295003, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1760, last_round_trip_time:1009, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:29.178822] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:29.198260] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:29.198270] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:29.417566] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:29.417581] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=11] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:29.417591] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=200) [2024-01-03 18:10:29.417598] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:29.417605] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:29.417612] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=819599224) [2024-01-03 18:10:29.417636] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:29.417643] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44E22C] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:29.417671] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44E22D] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:10:29.417788] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44E22D] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:29.436036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C3] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.436619] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C4] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.437046] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.437696] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C6] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.595691] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855D] [lt=30] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:29.595766] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855D] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:29.595779] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:29.595796] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=189, ddl_arg=NULL) [2024-01-03 18:10:29.807330] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94F9E] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.808119] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94F9F] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:10:29.809038] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA0] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.809822] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FA1] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:29.810615] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA2] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.811149] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FA3] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:29.811752] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA4] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:29.859424] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E1FD] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:29.891638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E1FD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:29.891666] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E1FD] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:29.891676] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E1FD] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:29.891700] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E1FD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:29.891776] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1EB] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:29.891845] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E1FD] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:29.891859] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E1FD] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:29.928282] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1EB] [lt=65] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:29.928327] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1EB] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:29.928342] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1EB] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:29.928367] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1EB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:29.928473] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1EB] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:29.928495] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1EB] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:29.936664] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1D7] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:29.967684] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1D7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:29.967719] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1D7] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:29.967729] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1D7] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:29.967753] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1D7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:29.967853] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1D7] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:29.967865] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1D7] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:30.006908] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB2A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=76, ddl_arg=NULL) [2024-01-03 18:10:30.026777] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=17] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:10:30.112896] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:30.112931] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:30.112968] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:30.180884] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:30.181001] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276629595658, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-459, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:30.181031] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:30.182370] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=73] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:30.182439] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276628295003, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1760, last_round_trip_time:1009, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:30.182460] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:30.296420] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944ED] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:30.296458] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944ED] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:30.296474] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944ED] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:30.296492] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944ED] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:10:30.431645] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:30.431747] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:30.431778] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:30.688306] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC02] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:30.688347] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC02] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:30.688365] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC02] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:30.688428] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC02] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:10:30.740614] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94404] [lt=118] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:30.892028] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1D8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:30.934293] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1D8] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:30.934311] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1D8] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:30.934321] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1D8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:30.934346] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1D8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:30.934419] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E230] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:30.934473] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1D8] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:30.934485] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1D8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:30.969196] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E230] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:30.969242] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E230] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:30.969261] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E230] [lt=17] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:30.969297] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E230] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:30.969371] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E200] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:30.969455] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E230] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:30.969475] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E230] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:31.001085] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E200] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:31.001145] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E200] [lt=56] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:31.001161] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E200] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:31.001194] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E200] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:31.001354] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E200] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:31.001374] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E200] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:31.115929] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:31.115970] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:31.115985] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:31.149461] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529083] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.150258] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529084] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:10:31.151092] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529085] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.151996] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529086] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=41, ddl_arg=NULL) [2024-01-03 18:10:31.152991] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF1-00060E079C529087] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.154177] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529088] [lt=86] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:31.155136] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529089] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.184572] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=54] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:31.184651] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276629595658, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-459, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:31.184671] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:31.185625] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:31.185694] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276630296388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1804, last_round_trip_time:1037, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:31.185718] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:31.438495] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C8] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.439274] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2C9] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.439834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CA] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.440412] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CB] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.597047] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855E] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:31.597090] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855E] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:31.597103] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855E] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:31.597130] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855E] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:10:31.812992] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA5] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.814077] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FA6] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:10:31.815002] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA7] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.815657] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FA8] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:10:31.816391] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FA9] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.816997] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FAA] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:31.817986] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FAB] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:31.934712] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E201] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:31.967607] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E201] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:31.967659] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E201] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:31.967674] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E201] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:31.967709] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E201] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:31.967817] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E201] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:31.967835] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E201] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:31.969646] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1F0] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:32.000030] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1F0] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:32.000071] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1F0] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:32.000081] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1F0] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:32.000106] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1F0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:32.000197] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1F0] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:32.000211] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1F0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:32.001557] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1DB] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:32.032910] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1DB] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:32.032971] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1DB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:32.032982] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1DB] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:32.033006] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1DB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:32.033129] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1DB] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:32.033142] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1DB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:32.118806] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=55] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:32.118835] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:32.118844] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:32.187280] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:32.187356] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276631597013, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-690, last_round_trip_time:940, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:32.187374] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:32.189363] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:32.189408] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276630296388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1804, last_round_trip_time:1037, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:32.189422] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:32.298122] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944EE] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:32.298175] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944EE] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:32.298188] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944EE] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:32.298206] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944EE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:10:32.689365] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC03] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:32.689451] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC03] [lt=81] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:32.689469] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC03] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:32.689492] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC03] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=174, ddl_arg=NULL) [2024-01-03 18:10:32.968009] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1DC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:33.001057] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1DC] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:33.001096] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1DC] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:33.001108] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1DC] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:33.001151] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1DC] [lt=18] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:33.001221] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E235] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:33.001327] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1DC] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:33.001346] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1DC] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:33.031648] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E235] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:33.031686] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E235] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:33.031698] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E235] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:33.031723] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E235] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:33.031850] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E235] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:33.031864] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E235] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:33.033316] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E204] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:33.063446] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E204] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:33.063484] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E204] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:33.063494] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E204] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:33.063519] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E204] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:33.063646] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E204] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:33.063663] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E204] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:33.063686] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:33.063705] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:33.063771] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=22] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:33.064565] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=33] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:33.064755] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:33.065857] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=27] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:33.065864] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:33.066078] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:33.067208] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:33.067214] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:33.067390] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=26] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:33.067401] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=9] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:33.067409] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:10:33.067512] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=13] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:33.067581] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=67] [dc=0] broadcast root address succeed [2024-01-03 18:10:33.069031] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:33.069092] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:33.069127] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:33.072211] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=21] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:33.074219] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=53] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:33.121525] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:33.121554] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:33.121563] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:33.156472] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52908A] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.157268] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52908B] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:33.158163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52908C] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.158883] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52908D] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=28, ddl_arg=NULL) [2024-01-03 18:10:33.159480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52908E] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.160144] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52908F] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:33.160894] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF1-00060E079C529090] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.190574] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=161] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:33.190691] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276631597013, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-690, last_round_trip_time:940, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:33.190714] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:33.193235] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:33.193301] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276632298070, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1735, last_round_trip_time:1039, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:33.193337] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:33.331639] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:33.331673] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=27] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:33.441359] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CC] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.441815] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CD] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.442254] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CE] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.442701] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2CF] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.575912] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=19] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:33.575923] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:33.575935] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=201) [2024-01-03 18:10:33.575944] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:33.576004] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=56] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:33.576017] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=10] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=823757628) [2024-01-03 18:10:33.576044] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:33.576079] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E206] [lt=30] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:33.576142] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E207] [lt=31] [dc=0] start to process rs list update task [2024-01-03 18:10:33.576361] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E207] [lt=32] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:33.598244] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D42855F] [lt=20] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:33.598283] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D42855F] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:33.598294] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D42855F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:33.598310] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D42855F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:10:33.819123] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FAC] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.820168] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FAD] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:10:33.820975] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FAE] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.821853] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FAF] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:33.822531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FB0] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:33.823319] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FB1] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:10:33.824203] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FB2] [lt=97] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:34.033222] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1F5] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:34.033258] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1F5] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:34.033268] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1F5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:34.033291] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1F5] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:34.033369] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1DF] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:34.033449] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1F5] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:34.033464] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1F5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:34.065335] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1DF] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:34.065379] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1DF] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:34.065393] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1DF] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:34.065448] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1DF] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:34.065524] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E238] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:34.065584] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1DF] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:34.065604] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1DF] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:34.097402] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E238] [lt=37] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:34.097430] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E238] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:34.097447] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E238] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:34.097481] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E238] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:34.097616] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E238] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:34.097639] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E238] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:34.124261] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:34.124290] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:34.124300] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:34.193501] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=49] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:34.193558] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276633598215, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-658, last_round_trip_time:951, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:34.193576] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:34.196102] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:34.196184] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276632298070, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1735, last_round_trip_time:1039, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:34.196216] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:34.299496] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944EF] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:34.299513] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944EF] [lt=14] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:34.299523] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944EF] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:34.299540] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944EF] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=76, ddl_arg=NULL) [2024-01-03 18:10:34.396798] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42847F] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:34.690368] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC04] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:34.690406] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC04] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:34.690417] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC04] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:34.690437] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC04] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:10:35.007761] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB2B] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:35.033605] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E239] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:35.063766] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E239] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:35.063804] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E239] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:35.063814] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E239] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:35.063838] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E239] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:35.063938] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E239] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:35.063970] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E239] [lt=24] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:35.065765] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E20A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:35.097156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E20A] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:35.097191] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E20A] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:35.097205] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E20A] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:35.097229] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E20A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:35.097324] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E20A] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:35.097337] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E20A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:35.098019] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1F8] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:35.126742] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:35.126767] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:35.126782] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:35.130511] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1F8] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:35.130554] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1F8] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:35.130568] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1F8] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:35.130603] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1F8] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:35.130731] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1F8] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:35.130751] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1F8] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:35.162136] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529092] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.162973] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529093] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:10:35.164062] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529094] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.164860] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529095] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:35.165609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529096] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.166292] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C529097] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:35.166996] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529098] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.197013] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:35.197084] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276633598215, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-658, last_round_trip_time:951, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:35.197123] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:35.198969] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:35.199033] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276634299467, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1861, last_round_trip_time:1085, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:35.199045] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:35.599322] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428560] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:35.599350] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428560] [lt=24] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:35.599366] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428560] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:35.599391] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428560] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=150, ddl_arg=NULL) [2024-01-03 18:10:35.603599] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:35.603665] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=43] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:35.603682] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:35.604622] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D1] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.605155] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D2] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.605710] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D3] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.606371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D4] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.741437] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94405] [lt=52] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:35.825563] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FB4] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.826382] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FB5] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:10:35.827231] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF2-00060E079EC94FB6] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.828117] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FB7] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=57, ddl_arg=NULL) [2024-01-03 18:10:35.829035] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FB8] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:35.830063] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FB9] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:35.830844] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FBA] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:36.064165] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1E4] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:36.092846] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1E4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:36.092891] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1E4] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:36.092902] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1E4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:36.092924] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1E4] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:36.093068] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1E4] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:36.093080] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1E4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:36.097509] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1F9] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:36.127695] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1F9] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:36.127731] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1F9] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:36.127742] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1F9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:36.127765] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1F9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:36.127867] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1F9] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:36.127889] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1F9] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:36.130479] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:36.130545] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=58] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:36.130559] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:36.130924] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E20D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:36.160513] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E20D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:36.160549] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E20D] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:36.160559] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E20D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:36.160582] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E20D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:36.160665] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E20D] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:36.160678] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E20D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:36.200394] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:36.200463] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=20] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276635599291, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-689, last_round_trip_time:968, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:36.200494] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:36.201685] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:36.201773] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276634299467, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1861, last_round_trip_time:1085, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:36.201812] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:36.300583] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944F0] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:36.300616] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944F0] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:36.300626] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944F0] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:36.300689] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944F0] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=166, ddl_arg=NULL) [2024-01-03 18:10:36.691478] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC05] [lt=27] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:36.691512] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC05] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:36.691523] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC05] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:36.691540] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC05] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:10:37.093289] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E23E] [lt=54] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:37.125765] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E23E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:37.125801] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E23E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:37.125810] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E23E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:37.125834] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E23E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:37.126002] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E23E] [lt=77] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:37.126024] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E23E] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:37.128087] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E20E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:37.134828] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:37.134880] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=42] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:37.134897] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:37.159616] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E20E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:37.159653] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E20E] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:37.159663] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E20E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:37.159688] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E20E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:37.159784] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E20E] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:37.159798] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E20E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:37.159820] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:10:37.159839] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:10:37.159930] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=45] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:10:37.160713] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:10:37.160851] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1FC] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:37.161086] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=111] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:10:37.162511] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:37.162525] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:37.162846] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=26] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:10:37.164086] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:10:37.164093] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:10:37.164283] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:10:37.164306] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:10:37.164319] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=10] [dc=0] start to process rs list update task [2024-01-03 18:10:37.164408] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:10:37.164425] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=15] [dc=0] broadcast root address succeed [2024-01-03 18:10:37.165844] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:10:37.165906] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=44] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:37.165917] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:10:37.168149] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C529099] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.168841] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:10:37.168942] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52909A] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:37.169751] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52909B] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.170511] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52909C] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:10:37.170724] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=35] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:10:37.171336] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52909D] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.172129] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C52909E] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:10:37.172968] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C52909F] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.195103] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1FC] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:37.195153] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1FC] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:37.195164] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1FC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:37.195192] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1FC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:37.195342] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1FC] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:37.195361] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1FC] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:37.203599] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:37.203649] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276635599291, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-689, last_round_trip_time:968, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:37.203664] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:37.205043] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:37.205084] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276636300554, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1940, last_round_trip_time:1102, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:37.205099] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:37.442928] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:10:37.442937] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:10:37.600391] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428561] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:37.600417] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428561] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:37.600428] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428561] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:37.600445] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428561] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:10:37.607358] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D5] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.608094] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D6] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.608687] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D7] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.609083] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D8] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.723929] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=10] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:37.724009] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=72] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:10:37.724028] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=12] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=202) [2024-01-03 18:10:37.724042] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:10:37.724056] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=11] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:10:37.724080] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=21] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=827905691) [2024-01-03 18:10:37.724119] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=12] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:10:37.724134] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34E210] [lt=13] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:10:37.724174] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34E211] [lt=14] [dc=0] start to process rs list update task [2024-01-03 18:10:37.724346] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34E211] [lt=23] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:10:37.832084] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FBB] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.833067] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FBC] [lt=87] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:10:37.834001] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FBD] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.834790] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FBE] [lt=82] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:37.835532] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FBF] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:37.836235] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FC0] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:10:37.836829] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FC1] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:38.126214] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E1FD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:38.138280] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:38.138318] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:38.138333] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:38.157115] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E1FD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:38.157150] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E1FD] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:38.157160] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E1FD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:38.157184] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E1FD] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:38.157282] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E1FD] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:38.157296] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E1FD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:38.159941] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1EB] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:38.188896] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1EB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:38.188931] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1EB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:38.188941] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1EB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:38.188982] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1EB] [lt=23] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:38.189087] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1EB] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:38.189099] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1EB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:38.195590] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E212] [lt=30] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:38.206921] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:38.207017] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276637600351, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-656, last_round_trip_time:968, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:38.207063] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:38.208047] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:38.208102] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276636300554, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1940, last_round_trip_time:1102, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:38.208149] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=41] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:38.227492] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E212] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:38.227578] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E212] [lt=82] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:38.227590] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E212] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:38.227614] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E212] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:38.227747] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E212] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:38.227760] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E212] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:38.301644] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944F1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:38.301680] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944F1] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:38.301691] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944F1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:38.301709] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944F1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:10:38.692587] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC06] [lt=40] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:38.692657] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC06] [lt=66] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:38.692673] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC06] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:38.692692] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC06] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=157, ddl_arg=NULL) [2024-01-03 18:10:39.142012] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=43] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:39.142033] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:39.142049] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:39.157491] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E245] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:39.186782] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E245] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:39.186819] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E245] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:39.186829] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E245] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:39.186852] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E245] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:39.186969] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E245] [lt=41] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:39.186982] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E245] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:39.189248] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E200] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:39.209777] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:39.209827] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276637600351, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-656, last_round_trip_time:968, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:39.209854] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:39.212225] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=85] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:39.212291] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276638301614, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1923, last_round_trip_time:1096, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:39.212310] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:39.228607] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E200] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:39.228652] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E200] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:39.228667] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E200] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:39.228704] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E200] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:39.228776] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E246] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:39.228867] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E200] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:39.228880] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E200] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:39.264424] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E246] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:39.264443] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E246] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:39.264454] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E246] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:39.264486] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E246] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:39.264605] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E246] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:39.264619] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E246] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:39.315631] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C5290A1] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.316343] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C5290A2] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:10:39.317024] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C5290A3] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.317931] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C5290A4] [lt=56] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:10:39.318594] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C5290A5] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.319306] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C5290A6] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:39.320057] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C5290A7] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.397856] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428480] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:10:39.601597] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D428562] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:39.601639] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D428562] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:39.601651] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D428562] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:39.601669] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D428562] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=122, ddl_arg=NULL) [2024-01-03 18:10:39.609816] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2D9] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.610493] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF0-00060E079A34E2DA] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.611097] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2DB] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.611659] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E2DC] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.974896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FC3] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.975699] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FC4] [lt=57] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:10:39.976806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FC5] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.977611] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FC6] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:10:39.978330] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FC7] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:39.979127] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94FC8] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:10:39.979981] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94FC9] [lt=58] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:10:40.008472] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DB2C] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:10:40.144825] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:10:40.144853] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:10:40.144863] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:10:40.187147] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14E1F0] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:40.213009] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:40.213058] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276639601554, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-686, last_round_trip_time:959, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:40.213071] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:10:40.215752] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:10:40.215808] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276638301614, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1923, last_round_trip_time:1096, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:10:40.215836] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:10:40.216688] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14E1F0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:40.216726] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14E1F0] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:40.216743] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14E1F0] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:40.216777] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14E1F0] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:40.216899] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14E1F0] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:40.216912] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14E1F0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:40.229032] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34E217] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:40.261109] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34E217] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:40.261145] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34E217] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:40.261155] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34E217] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:40.261178] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34E217] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:40.261291] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34E217] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:40.261308] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34E217] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:40.264765] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24E203] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:10:40.295768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24E203] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:10:40.295805] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24E203] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:10:40.295816] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24E203] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:10:40.295844] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24E203] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:10:40.295998] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24E203] [lt=56] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:10:40.296013] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24E203] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:10:40.303017] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F9944F2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:40.303037] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F9944F2] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:40.303048] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F9944F2] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:40.303076] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F9944F2] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=178, ddl_arg=NULL) [2024-01-03 18:10:40.605449] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=10] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:40.605496] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=20] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:40.605514] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:10:40.693796] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DC07] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:10:40.693834] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DC07] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:10:40.693845] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DC07] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:10:40.693864] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DC07] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=115, ddl_arg=NULL) [2024-01-03 18:10:40.742648] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA94406] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL)