[2024-01-03 18:05:35.713704] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF13] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.713746] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF13] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.713760] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF13] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.713794] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF13] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.713873] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF45] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:35.713932] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF13] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.713973] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF13] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:35.745084] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF45] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.745118] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF45] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.745127] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF45] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.745150] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF45] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.745204] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF32] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:35.745252] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF45] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.745265] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF45] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:35.773148] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF32] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:35.773181] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF32] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:35.773191] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF32] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:35.773213] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF32] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:35.773336] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF32] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:35.773349] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF32] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.126189] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:36.126228] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:36.126239] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:36.126255] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:36.309019] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:36.309054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:36.309064] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:36.364208] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:36.364279] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276336126159, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-688, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:36.364308] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:36.364669] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:36.364762] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276335427857, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1179, last_round_trip_time:797, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:36.364824] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=57] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:36.488995] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C52] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.489611] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C53] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:36.490206] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF1-00060E079C528C54] [lt=78] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.490753] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C55] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:36.491313] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2009][466][YB42C0A86EF1-00060E079C528C56] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.491931] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C57] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:36.492484] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C58] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.549830] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:36.549867] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:36.549878] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:36.549894] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB6F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=96, ddl_arg=NULL) [2024-01-03 18:05:36.678047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04A] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.678588] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04B] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.678997] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF0-00060E079A34E04C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.679468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04D] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:36.714119] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF33] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.745235] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF33] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.745270] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF33] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.745283] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF33] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.745321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF33] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.745368] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF52] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.745427] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF33] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.745440] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF33] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.773063] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF52] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.773099] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF52] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.773109] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF52] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.773132] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF52] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.773232] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF52] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.773244] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF52] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:36.773517] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF16] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:36.798623] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF16] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:36.798656] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF16] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:36.798669] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF16] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:36.798702] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF16] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:36.798826] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF16] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:36.798846] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF16] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.151123] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B74] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.151850] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B75] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:37.152554] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B76] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.153213] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B77] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:37.153776] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B78] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.154346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B79] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:37.154979] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7A] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:37.311667] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:37.311696] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:37.311705] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:37.366822] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:37.366870] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276336126159, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-688, last_round_trip_time:794, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:37.366900] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:37.368353] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:37.368444] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=38] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276335427857, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1179, last_round_trip_time:797, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:37.368480] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:37.368517] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=17] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:37.368536] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:37.368631] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=27] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:37.369450] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=37] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:37.369799] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:37.370995] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=65] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:37.371007] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:37.371355] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:37.372427] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=29] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:37.372437] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:37.372784] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=29] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:37.372816] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=28] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:37.372871] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=51] [dc=0] start to process rs list update task [2024-01-03 18:05:37.373017] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=51] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:37.373047] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=28] [dc=0] broadcast root address succeed [2024-01-03 18:05:37.374800] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:37.374878] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=53] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:37.374933] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=53] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:37.377465] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:37.378995] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=64] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:37.428972] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:37.429004] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:37.429018] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:37.429034] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CB] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:05:37.596579] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:37.596590] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:37.802764] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4A] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:37.802799] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4A] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:37.802809] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4A] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:37.802831] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:37.802892] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF36] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:37.802926] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4A] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:37.802937] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4A] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.803231] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:37.803243] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:37.803264] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=11] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:37.803298] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF56] [lt=10] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:37.830079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF36] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:37.830114] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF36] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:37.830124] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF36] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:37.830147] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF36] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:37.830244] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF36] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:37.830256] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF36] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:37.830286] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DF37] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:37.830431] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DF37] [lt=11] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:38.127298] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:38.127359] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=57] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:38.127371] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:38.127388] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:05:38.314031] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=46] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:38.314060] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:38.314069] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:38.369417] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:38.369467] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276338127254, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-584, last_round_trip_time:791, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:38.369494] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:38.370941] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:38.371002] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276337428908, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1237, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:38.371013] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:38.493448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.494094] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:05:38.494676] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.495204] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5C] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:38.495714] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5D] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.496284] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C5E] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:38.496855] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C5F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.550636] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:38.550674] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:38.550686] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:38.550701] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB70] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:38.680349] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04E] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.680799] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E04F] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.681222] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E050] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.681660] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E051] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:38.776708] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF38] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.807586] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF38] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.807624] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF38] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.807633] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF38] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.807657] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF38] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.807720] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.807758] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF38] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.807771] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF38] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:38.833354] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF1A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.833386] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF1A] [lt=29] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.833395] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.833417] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF1A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.833473] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF4D] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:38.833512] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF1A] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.833524] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF1A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:38.860039] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4D] [lt=96] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:38.860087] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4D] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:38.860100] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4D] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:38.860122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:38.860240] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4D] [lt=19] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:38.860255] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.155827] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7B] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.156515] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B7C] [lt=71] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:39.157220] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.157988] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B7E] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=38, ddl_arg=NULL) [2024-01-03 18:05:39.158539] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B7F] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.159053] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B80] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:39.159586] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B81] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:39.316838] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:39.316871] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:39.316881] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:39.322668] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428444] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:39.372358] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:39.372413] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276338127254, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-584, last_round_trip_time:791, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:39.372438] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:39.373721] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:39.373787] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276337428908, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1237, last_round_trip_time:809, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:39.373825] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:39.430071] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:39.430110] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:39.430122] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:39.430140] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CC] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=146, ddl_arg=NULL) [2024-01-03 18:05:39.807914] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF4E] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.835612] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF4E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.835648] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF4E] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.835657] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF4E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.835680] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF4E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.835741] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.835781] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF4E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.835793] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF4E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.861963] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.862003] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF5B] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.862013] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF5B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.862035] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF5B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.862092] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:39.862135] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF5B] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.862148] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF5B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.890750] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:39.890783] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3B] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:39.890793] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:39.890816] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3B] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:39.890911] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3B] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:39.890923] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3B] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:39.966784] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF0] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:40.128483] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.128540] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:40.128550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:40.128566] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445C] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=116, ddl_arg=NULL) [2024-01-03 18:05:40.319235] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:40.319265] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:40.319276] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:40.376006] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:40.376055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276340128453, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-702, last_round_trip_time:805, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:40.376068] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:40.376843] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:40.376885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276339429997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1187, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:40.376896] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:40.498102] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C61] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.498885] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C62] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:40.499667] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C63] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.500249] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C64] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:40.500781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C65] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.501306] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C66] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:40.501987] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C67] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.551547] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.551586] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:40.551598] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:40.551615] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB71] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=104, ddl_arg=NULL) [2024-01-03 18:05:40.688047] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CA] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:40.835988] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3C] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.845450] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.845520] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=42] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.845537] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:40.846782] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2013][474][YB42C0A86EF0-00060E079A34E053] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.847597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E054] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.848078] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E055] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.848492] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E056] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:40.875475] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.875513] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3C] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.875524] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.875548] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.875624] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF1F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.875712] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3C] [lt=69] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.875727] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3C] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.904377] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF1F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.904422] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF1F] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.904433] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF1F] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.904457] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF1F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.904518] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF51] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:40.904606] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF1F] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.904626] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF1F] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.934717] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF51] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:40.934749] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF51] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:40.934758] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF51] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:40.934782] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF51] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:40.934909] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF51] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:40.934932] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF51] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:40.935009] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=9] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:40.935030] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:40.935094] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=24] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:40.935780] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:40.936128] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=35] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:40.937435] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=15] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:40.937447] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:40.937858] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=27] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:40.939362] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:40.939379] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=15] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:40.939606] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:40.939630] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=22] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:40.939639] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:05:40.939722] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=23] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:40.939744] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:05:40.941252] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=38] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:40.941322] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:40.941360] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=34] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:40.944395] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=11] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:40.946464] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=37] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:41.160578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B83] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.161435] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B84] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:41.162162] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B85] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.162935] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B86] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:41.163616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF2-00060E079EC94B87] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.164437] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B88] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:41.165387] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B89] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:41.233246] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=9] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:41.233279] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=26] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:41.418483] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:41.418492] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:41.418503] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=128) [2024-01-03 18:05:41.418509] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:41.418515] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:41.418524] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=7] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=531600136) [2024-01-03 18:05:41.418556] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=8] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:41.418579] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF53] [lt=21] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:41.418611] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF54] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:05:41.418716] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF54] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:41.431328] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:41.431366] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:41.431377] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:41.431394] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CD] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=95, ddl_arg=NULL) [2024-01-03 18:05:41.876003] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF60] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.904863] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF60] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.904897] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF60] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.904909] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF60] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.904944] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF60] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.905088] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.905145] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF60] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.905165] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF60] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:41.932779] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF3F] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.932812] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF3F] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.932821] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.932845] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF3F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.932985] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF3F] [lt=47] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.932999] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF3F] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:41.935127] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF22] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:41.965816] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF22] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:41.965861] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF22] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:41.965872] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF22] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:41.965896] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF22] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:41.966079] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF22] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:41.966092] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF22] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:42.129735] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:42.129784] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:42.129799] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:42.129824] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445D] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=163, ddl_arg=NULL) [2024-01-03 18:05:42.324867] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:42.324899] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:42.324909] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:42.380986] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=77] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:42.381055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276342129663, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-524, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:42.381137] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=74] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:42.381311] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:42.381354] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276341431299, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1021, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:42.381379] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:42.503735] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C68] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.504991] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C69] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=45, ddl_arg=NULL) [2024-01-03 18:05:42.505908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6A] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.506736] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C6B] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:42.507473] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6C] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.508335] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C6D] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:42.509122] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C6E] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.552633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:42.552705] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=67] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:42.552718] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:42.552747] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB72] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=153, ddl_arg=NULL) [2024-01-03 18:05:42.849338] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E057] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.849935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E058] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.850609] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF0-00060E079A34E059] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.851464] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05A] [lt=65] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:42.905320] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.935742] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF23] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:42.935788] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF23] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:42.935799] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF23] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:42.935822] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:42.935895] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF57] [lt=22] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.935932] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF23] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:42.935943] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF23] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:42.968869] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF57] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:42.968911] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF57] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:42.968927] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF57] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:42.968976] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF57] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:42.969033] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF63] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:42.969091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF57] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:42.969113] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF57] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.000207] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF63] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.000243] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF63] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.000253] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF63] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.000277] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF63] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.000399] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF63] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.000413] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF63] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.166736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8A] [lt=74] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.167637] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8B] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:05:43.168796] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8C] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.170019] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8D] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:43.170687] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B8E] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.171380] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B8F] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:43.172017] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B90] [lt=57] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:43.328083] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:43.328113] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:43.328123] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:43.384114] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:43.384165] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276342129663, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-524, last_round_trip_time:808, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:43.384179] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:43.384386] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:43.384472] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276341431299, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1021, last_round_trip_time:801, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:43.384508] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:43.432607] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:43.432661] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=50] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:43.432672] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:43.432693] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284CE] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:05:43.936161] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF64] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:43.968142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF64] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.968181] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF64] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.968192] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF64] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.968228] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF64] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.968355] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF64] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.968369] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF64] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:43.969308] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF44] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:43.999707] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF44] [lt=54] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:43.999742] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF44] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:43.999752] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF44] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:43.999776] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF44] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:43.999893] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF44] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:43.999912] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF44] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:44.000602] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF26] [lt=32] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:44.028866] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF26] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:44.028888] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF26] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:44.028901] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF26] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:44.028938] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF26] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:44.029091] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF26] [lt=36] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:44.029110] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF26] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:44.131095] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:44.131136] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:44.131153] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:44.131177] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445E] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=143, ddl_arg=NULL) [2024-01-03 18:05:44.323466] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428445] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:44.331455] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:44.331495] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=33] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:44.331510] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:44.386540] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:44.386590] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276344131036, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-544, last_round_trip_time:844, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:44.386602] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:44.387194] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:44.387236] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276343432577, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1094, last_round_trip_time:817, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:44.387248] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:44.553780] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:44.553819] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:44.553848] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=26] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:44.553866] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB73] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:05:44.644361] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C70] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.645043] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C71] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:44.645626] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C72] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.646104] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C73] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:44.646611] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C74] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.647176] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C75] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:44.647699] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C76] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.852531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05B] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853021] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05C] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853390] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.853724] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E05E] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:44.967455] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF1] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:44.968578] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF27] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:44.998452] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF27] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:44.998491] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF27] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:44.998501] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF27] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:44.998525] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF27] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:44.998625] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF27] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:44.998637] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF27] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.000118] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF5C] [lt=23] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:45.030496] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF5C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:45.030532] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF5C] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:45.030541] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF5C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:45.030568] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF5C] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:45.030628] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF67] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:45.030670] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF5C] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:45.030683] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF5C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.056900] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF67] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:45.057007] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF67] [lt=103] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:45.057019] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF67] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:45.057041] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF67] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:45.057128] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF67] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:45.057141] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF67] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:45.057162] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:45.057180] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:45.057246] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:45.057915] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=24] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:45.058144] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=10] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:45.059069] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=22] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:45.059077] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:45.059234] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:45.060190] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:45.060197] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:45.060372] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:45.060393] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:45.060401] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:05:45.060476] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:45.060489] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:05:45.061760] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:45.061805] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=29] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:45.061815] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:45.064057] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:45.065477] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:45.284337] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=19] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:45.284349] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=8] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:45.302574] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B92] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.303301] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B93] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:45.303886] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B94] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.304500] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B95] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:45.305054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B96] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.305568] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B97] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:45.306052] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B98] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:45.333942] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:45.334004] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:45.334051] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:45.389094] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:45.389144] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276344131036, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-544, last_round_trip_time:844, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:45.389156] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:45.522411] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:45.522421] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:45.522432] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=129) [2024-01-03 18:05:45.522440] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:45.522448] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:45.522456] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=535704068) [2024-01-03 18:05:45.522487] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:45.522496] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DF69] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:45.522525] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DF6A] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:45.522651] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DF6A] [lt=8] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:45.689068] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CB] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:45.847054] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.847142] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.847176] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=22] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:45.998814] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.026253] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.026288] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF49] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.026298] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF49] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.026321] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF49] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.026419] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF49] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.026433] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF49] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.030834] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2A] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.060273] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.060321] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2A] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.060335] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2A] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.060368] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2A] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.060434] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:46.060485] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2A] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.060498] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.085432] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:46.085464] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF5F] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:46.085473] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF5F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:46.085496] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF5F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:46.085592] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF5F] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:46.085606] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF5F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:46.132158] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:46.132191] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:46.132201] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:46.132216] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99445F] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=89, ddl_arg=NULL) [2024-01-03 18:05:46.336885] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:46.336917] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:46.336926] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:46.392343] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:46.392356] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:46.392404] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276345433640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1176, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:46.392438] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:46.392413] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276346132131, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-649, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:46.392455] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:46.554633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:46.554672] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:46.554683] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:46.554700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB74] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:05:46.648688] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C77] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.649406] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C78] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:46.650013] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C79] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.650601] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7A] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:05:46.651104] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C7B] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.651550] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7C] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=4, ddl_arg=NULL) [2024-01-03 18:05:46.652115] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C7D] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.854697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E060] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.855572] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E061] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.856047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E062] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:46.856489] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E063] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.026625] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF60] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.061215] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF60] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.061251] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF60] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.061261] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF60] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.061283] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF60] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.061346] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.061452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF60] [lt=77] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.061467] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF60] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.087982] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.088012] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF6D] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.088022] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF6D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.088045] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF6D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.088143] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF6D] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.088156] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF6D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.088104] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:47.115750] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2D] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:47.115787] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2D] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:47.115803] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2D] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:47.115836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2D] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:47.115935] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:47.115964] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:47.306994] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B99] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.307878] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9A] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:47.308468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9B] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.309210] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9C] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:47.309781] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.310368] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94B9E] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:47.310896] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94B9F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:47.339376] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:47.339405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:47.339414] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:47.395156] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:47.395168] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=15] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:47.395228] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276346132131, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-649, last_round_trip_time:843, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:47.395262] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:47.395230] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276345433640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1176, last_round_trip_time:840, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:47.395291] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=55] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:47.434565] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:47.434608] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:47.434620] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:47.434642] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:05:48.061734] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF2E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.089263] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF2E] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.089297] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF2E] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.089306] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF2E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.089329] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF2E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.089388] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF4E] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.089425] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF2E] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.089436] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF2E] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.115793] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF4E] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.115826] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF4E] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.115836] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF4E] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.115859] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF4E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.116009] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF4E] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.116022] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF4E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.116127] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:48.133336] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:48.133375] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:48.133391] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994460] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:48.133407] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994460] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:05:48.143704] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF70] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:48.143745] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF70] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:48.143759] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF70] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:48.143782] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:48.143881] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF70] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:48.143895] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF70] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:48.342083] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:48.342116] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:48.342127] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:48.397927] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:48.397998] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276348133305, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-647, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:48.398011] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:48.398175] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:48.398218] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276347434522, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1174, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:48.398263] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:48.555652] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:48.555702] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:48.555715] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:48.555732] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB75] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:05:48.653317] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528C7E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.654270] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C7F] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:05:48.655118] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C80] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.655812] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C81] [lt=110] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:48.656651] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C82] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.657264] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C83] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:05:48.658036] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C84] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.857403] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E064] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858081] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E065] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858503] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E066] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:48.858987] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E067] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.089604] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.119562] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF71] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.119596] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF71] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.119606] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF71] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.119650] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.119716] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF65] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.119760] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF71] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.119773] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF71] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.147721] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF65] [lt=30] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.147758] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF65] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.147768] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF65] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.147792] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF65] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.147849] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF31] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:49.147895] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF65] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.147908] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF65] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.176877] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF31] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:49.176907] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF31] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:49.176916] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF31] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:49.176940] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF31] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:49.177064] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF31] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:49.177076] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF31] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:49.177098] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:49.177117] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:49.177177] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:49.178131] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=20] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:49.178511] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:49.179721] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=37] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:49.179734] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:49.179973] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:49.180808] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:49.180815] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:49.181007] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:49.181035] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=25] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:49.181043] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:05:49.181123] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:49.181132] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:05:49.182600] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:49.182667] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=47] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:49.182679] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:49.185629] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:49.187307] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=50] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:49.312066] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA0] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.312847] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA1] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:49.313490] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA2] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.314306] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF2-00060E079EC94BA3] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:49.314971] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA4] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.315628] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:49.316351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA6] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:49.324269] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428446] [lt=72] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:49.344439] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:49.344499] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=50] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:49.344529] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:49.400964] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=63] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:49.400979] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=65] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:49.401016] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276348133305, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-647, last_round_trip_time:845, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:49.401029] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:49.401045] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276347434522, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1174, last_round_trip_time:837, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:49.401064] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:49.435670] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:49.435706] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:49.435717] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:49.435735] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D1] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:05:49.448409] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:49.448511] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=93] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:49.685761] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=13] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:49.685771] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:49.685783] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=130) [2024-01-03 18:05:49.685792] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:49.685799] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:49.685806] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=539867418) [2024-01-03 18:05:49.685834] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:49.685843] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14DF33] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:49.685872] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14DF34] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:49.686107] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14DF34] [lt=24] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:49.968117] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF2] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:50.119936] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF53] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.134386] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:50.134439] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:50.134456] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994461] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:50.134482] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994461] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=174, ddl_arg=NULL) [2024-01-03 18:05:50.151382] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF53] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.151426] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF53] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.151441] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF53] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.151467] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF53] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.151540] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.151623] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF53] [lt=55] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.151637] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF53] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.181352] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF74] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.181387] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF74] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.181396] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF74] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.181419] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.181478] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF68] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:50.181525] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF74] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.181538] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF74] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.210677] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF68] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:50.210716] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF68] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:50.210726] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF68] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:50.210751] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF68] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:50.210902] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF68] [lt=39] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:50.210922] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF68] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:50.347021] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=44] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:50.347055] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:50.347065] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:50.403841] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:50.403896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276349435640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1101, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:50.403909] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:50.404105] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:50.404148] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276350134340, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:50.404189] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:50.556535] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:50.556551] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=13] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:50.556559] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=6] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:50.556574] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB76] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=69, ddl_arg=NULL) [2024-01-03 18:05:50.659091] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C86] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.659828] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C87] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:05:50.660591] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C88] [lt=73] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.661325] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C89] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=33, ddl_arg=NULL) [2024-01-03 18:05:50.661935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8A] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.662619] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C8B] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:50.663371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8C] [lt=59] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:50.690033] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CC] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:51.015803] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=55] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.015866] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.015882] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:51.016871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E069] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.017465] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06A] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.018203] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06B] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.018823] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06C] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.151789] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF69] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.182097] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF69] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.182133] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF69] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.182142] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF69] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.182165] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF69] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.182221] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF37] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.182263] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF69] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.182276] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF69] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.212043] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF37] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.212071] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF37] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.212081] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF37] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.212104] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF37] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.212225] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF37] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.212238] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF37] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.212189] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF77] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:51.242699] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF77] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:51.242731] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF77] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:51.242741] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF77] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:51.242764] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF77] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:51.242860] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF77] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:51.242872] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF77] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:51.317574] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BA8] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.318299] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BA9] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:51.319005] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAA] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.319985] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BAB] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:51.320793] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAC] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.321529] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BAD] [lt=49] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:51.322259] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAE] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:51.350118] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:51.350140] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:51.350154] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:51.407009] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=82] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:51.407087] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276349435640, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1101, last_round_trip_time:842, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:51.407129] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=38] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:51.407199] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:51.407243] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276350134340, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-603, last_round_trip_time:807, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:51.407255] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:51.436829] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:51.436871] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:51.436890] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:51.436914] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D2] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:05:52.135604] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:52.135657] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:52.135672] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994462] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:52.135688] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994462] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:05:52.182443] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF78] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.214936] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF78] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.215002] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF78] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.215019] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF78] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.215055] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF78] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.215131] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF58] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.215197] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF78] [lt=37] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.215220] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF78] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.244718] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.244760] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF58] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.244775] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF58] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.244806] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.244909] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF6C] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:52.244963] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF58] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.244976] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF58] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.273911] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF6C] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:52.273938] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF6C] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:52.273983] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF6C] [lt=43] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:52.274006] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF6C] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:52.274128] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF6C] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:52.274148] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF6C] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:52.353137] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:52.353161] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:52.353174] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:52.410122] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=45] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:52.410176] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276351436799, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1057, last_round_trip_time:854, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:52.410191] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:52.410527] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:52.410629] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276352135564, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-703, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:52.410667] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:52.557531] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:52.557589] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=55] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:52.557600] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:52.557618] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB77] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=168, ddl_arg=NULL) [2024-01-03 18:05:52.664674] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8D] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.665449] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C8E] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:05:52.666108] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C8F] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.666785] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C90] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:52.667372] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C91] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:52.667916] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C92] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:05:52.668586] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C93] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.019849] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06D] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.020403] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.020998] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E06F] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.021853] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E070] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.215380] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF6D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.245367] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF6D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.245404] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF6D] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.245413] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF6D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.245437] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF6D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.245534] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF6D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.245497] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF3C] [lt=15] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.245547] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF6D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.275743] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF3C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.275780] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF3C] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.275790] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF3C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.275813] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF3C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.275885] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:53.275911] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF3C] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.275929] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF3C] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.305033] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF7B] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:53.305069] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF7B] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:53.305078] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF7B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:53.305103] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:53.305200] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF7B] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:53.305213] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF7B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:53.305234] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:53.305252] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:53.305313] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=21] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:53.306283] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:53.306479] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:53.307600] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=41] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:53.307626] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=24] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:53.307833] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=25] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:53.308902] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=19] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:53.308911] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:53.309211] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=44] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:53.309285] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=71] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:53.309295] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:53.309388] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:53.309396] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:05:53.310828] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:53.310883] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=38] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:53.310895] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=10] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:53.313417] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:53.315068] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=38] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:53.323331] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BAF] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.324131] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB0] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:53.324833] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB1] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.325587] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB2] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:53.326296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB3] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.326969] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB4] [lt=60] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:05:53.327639] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB5] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:53.356464] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=35] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:53.356509] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=36] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:53.356524] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:53.412968] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=75] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:53.413054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276351436799, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1057, last_round_trip_time:854, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:53.413068] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:53.413552] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=61] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:53.413614] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276352135564, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-703, last_round_trip_time:836, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:53.413646] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:53.438034] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:53.438077] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:53.438088] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:53.438108] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:53.565593] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:53.565609] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=12] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:53.787467] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:53.787481] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:53.787489] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=131) [2024-01-03 18:05:53.787495] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:53.787501] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:53.787506] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=543969119) [2024-01-03 18:05:53.787526] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:53.787535] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DF7D] [lt=7] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:53.787558] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DF7E] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:05:53.787643] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DF7E] [lt=5] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:54.136862] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=13] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:54.136932] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=67] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:54.136944] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994463] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:54.136989] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994463] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=161, ddl_arg=NULL) [2024-01-03 18:05:54.245720] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF5D] [lt=64] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.279016] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF5D] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.279047] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF5D] [lt=28] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.279057] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF5D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.279081] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF5D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.279151] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF70] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.279164] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF5D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.279177] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF5D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.307852] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF70] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.307894] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF70] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.307909] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF70] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.307942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF70] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.308073] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF3F] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:54.308151] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF70] [lt=63] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.308165] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF70] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.325422] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428447] [lt=60] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:54.340873] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF3F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:54.340926] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF3F] [lt=49] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:54.340944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF3F] [lt=16] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:54.341018] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF3F] [lt=50] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:54.341175] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF3F] [lt=38] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:54.341196] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF3F] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:54.359452] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:54.359481] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:54.359490] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:54.415837] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:54.415891] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276353437997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1049, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:54.415904] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:54.416271] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:54.416313] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276354136831, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:54.416324] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:54.558537] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:54.558558] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:54.558570] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:54.558587] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB78] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:54.823401] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C95] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.824130] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C96] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:54.825063] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C97] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.825836] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C98] [lt=66] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:54.826533] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C99] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.827218] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C9A] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:54.827912] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9B] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:54.968814] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF3] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:55.022799] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E071] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.023527] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E072] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.024130] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E073] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.024684] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E074] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.279365] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.311062] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF40] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.311106] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF40] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.311120] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF40] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.311154] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.311222] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF81] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.311312] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF40] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.311330] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF40] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.340473] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF81] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.340513] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF81] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.340527] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF81] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.340557] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF81] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.340692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF81] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.340707] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF81] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.341354] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF60] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:55.362938] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:55.363005] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=58] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:55.363019] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:55.369682] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF60] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:55.369714] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF60] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:55.369724] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF60] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:55.369747] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF60] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:55.369877] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF60] [lt=53] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:55.369898] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF60] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:55.418652] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:55.418700] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276353437997, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1049, last_round_trip_time:856, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:55.418731] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:55.419106] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:55.419172] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276354136831, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-612, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:55.419218] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=39] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:55.439500] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:55.439539] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:55.439550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:55.439567] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D4] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:05:55.482393] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB7] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.483324] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BB8] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=53, ddl_arg=NULL) [2024-01-03 18:05:55.484172] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BB9] [lt=80] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.484846] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBA] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:05:55.485471] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBB] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.486177] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBC] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:55.486893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBD] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:55.691162] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CD] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:56.017691] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.017740] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.017757] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:05:56.138371] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:56.138412] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:56.138423] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994464] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:56.138440] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994464] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=119, ddl_arg=NULL) [2024-01-03 18:05:56.311488] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF75] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.339332] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF75] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.339366] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF75] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.339376] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF75] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.339399] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF75] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.339503] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF75] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.339524] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF75] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.340849] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF61] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.366003] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:56.366034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:56.366044] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:56.368357] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF61] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.368391] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF61] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.368401] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF61] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.368424] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF61] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.368522] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF61] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.368539] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF61] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.370051] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF84] [lt=81] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:56.399487] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF84] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:56.399522] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF84] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:56.399532] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF84] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:56.399556] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF84] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:56.399656] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF84] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:56.399668] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF84] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:56.421094] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:56.421143] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276355439470, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:56.421155] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:56.421860] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:56.421901] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276356138328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-473, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:56.421916] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:56.559468] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:56.559506] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:56.559521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:56.559544] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB79] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=111, ddl_arg=NULL) [2024-01-03 18:05:56.828806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9C] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.829491] INFO [RS] ob_rs_rpc_processor.h:196 [2099][646][YB42C0A86EF1-00060E079C528C9D] [lt=50] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:05:56.830159] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528C9E] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.830788] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528C9F] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:56.831360] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA0] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:56.831866] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA1] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:56.832376] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA2] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.025513] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E076] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E077] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026487] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E078] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.026936] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2007][462][YB42C0A86EF0-00060E079A34E079] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.339720] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF62] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.368218] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF62] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.368251] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF62] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.368260] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF62] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.368284] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF62] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.368378] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF62] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.368391] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF62] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.368681] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:57.368700] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF78] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.368710] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:57.368720] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:57.401816] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF78] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.401862] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF78] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.401877] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF78] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.401909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF78] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.401996] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF47] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:57.402104] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF78] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.402124] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF78] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.402189] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=27] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:05:57.402212] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:05:57.402314] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=29] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:05:57.403048] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=38] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:05:57.403375] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:05:57.404470] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:57.404479] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:57.404774] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=31] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:05:57.405610] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:05:57.405619] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:05:57.405924] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:05:57.405996] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=68] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:05:57.406008] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:05:57.406125] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:05:57.406154] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=27] [dc=0] broadcast root address succeed [2024-01-03 18:05:57.407885] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:05:57.408009] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=100] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:57.408025] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:05:57.411184] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:05:57.413164] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=46] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:05:57.423812] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:57.423861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276355439470, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-949, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:57.423892] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:57.424287] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:57.424328] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276356138328, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-473, last_round_trip_time:872, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:57.424339] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:57.428913] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:57.428978] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF47] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:57.429002] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF47] [lt=22] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:57.429025] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:57.429129] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF47] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:57.429141] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF47] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:57.441103] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:57.441145] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:57.441161] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:57.441187] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D5] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=243, ddl_arg=NULL) [2024-01-03 18:05:57.488067] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BBE] [lt=19] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.488786] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BBF] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:57.489465] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC0] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.490243] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC1] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:05:57.490908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF2-00060E079EC94BC2] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.491538] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC3] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:57.492160] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC4] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:57.769342] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:05:57.769353] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:05:57.983409] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:57.983419] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:05:57.983431] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=132) [2024-01-03 18:05:57.983440] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:05:57.983447] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:05:57.983454] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=548165066) [2024-01-03 18:05:57.983478] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:05:57.983492] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF7A] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:05:57.983518] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF7B] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:05:57.983639] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF7B] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:05:58.139696] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=51] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:58.139743] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=42] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:58.139759] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994465] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:58.139778] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994465] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=113, ddl_arg=NULL) [2024-01-03 18:05:58.368594] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF65] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.371077] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:58.371089] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:58.371098] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:58.396244] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF65] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.396277] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF65] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.396287] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF65] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.396311] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF65] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.396448] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF65] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.396468] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF65] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.402314] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF48] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.426671] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:58.426719] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276357441072, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-886, last_round_trip_time:911, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:58.426734] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:58.427012] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:58.427052] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276358139667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:922, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:58.427086] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:58.430291] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF48] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.430317] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF48] [lt=24] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.430326] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF48] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.430348] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF48] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.430426] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF66] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:58.430612] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF48] [lt=161] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.430642] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF48] [lt=20] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.461645] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF66] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:58.461681] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF66] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:58.461691] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF66] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:58.461716] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF66] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:58.461811] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF66] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:58.461823] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF66] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:58.560337] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:58.560373] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:58.560384] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:58.560400] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:05:58.833285] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA3] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.834180] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA4] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:58.834821] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA5] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.835315] INFO [RS] ob_rs_rpc_processor.h:196 [2096][640][YB42C0A86EF1-00060E079C528CA6] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:05:58.835887] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA7] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:58.836473] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CA8] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:05:58.837010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CA9] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.027711] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07A] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.028247] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07B] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.028611] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07C] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.029039] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.326402] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428448] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:05:59.373862] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=64] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:05:59.373896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:05:59.373912] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:05:59.396650] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF8D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.427079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF8D] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.427097] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF8D] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.427106] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF8D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.427129] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.427219] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF8D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.427231] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF8D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.429500] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:59.429592] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=43] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:05:59.429550] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276358139667, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-741, last_round_trip_time:922, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:59.429619] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=63] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:05:59.429660] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276357441072, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-886, last_round_trip_time:911, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:05:59.429690] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:05:59.430836] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF80] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.442223] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:05:59.442286] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=56] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:05:59.442306] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=16] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:05:59.442333] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D6] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=156, ddl_arg=NULL) [2024-01-03 18:05:59.467000] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF80] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.467046] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF80] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.467060] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF80] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.467093] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF80] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.467165] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF8E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:05:59.467234] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF80] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.467254] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF80] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.493269] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC5] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.494251] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC6] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:05:59.494857] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BC7] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.495474] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BC8] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:05:59.496133] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94BC9] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.496649] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BCA] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:05:59.497213] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCB] [lt=51] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:05:59.497292] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF8E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:05:59.497313] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF8E] [lt=19] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:05:59.497323] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF8E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:05:59.497346] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF8E] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:05:59.497502] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF8E] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:05:59.497517] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF8E] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:05:59.969478] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF4] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:00.140771] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:00.140817] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=39] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:00.140834] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994466] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:00.140856] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994466] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=117, ddl_arg=NULL) [2024-01-03 18:06:00.376812] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:00.376842] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:00.376851] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:00.427384] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF4B] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.431979] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:00.432029] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276360140739, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-629, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:00.432042] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:00.432068] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:00.432109] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276359442179, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1066, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:00.432144] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:00.459853] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF4B] [lt=29] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.459875] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF4B] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.459884] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF4B] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.459908] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF4B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.460051] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF4B] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.460069] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF4B] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.467440] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF6B] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.499331] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF6B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.499373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF6B] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.499385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF6B] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.499418] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF6B] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.499547] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF6B] [lt=13] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.499498] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:00.499564] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF6B] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.530180] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF83] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:00.530219] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF83] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:00.530229] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:00.530253] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF83] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:00.530343] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF83] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:00.530357] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF83] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:00.561136] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:00.561175] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:00.561186] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:00.561206] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:00.692140] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943CE] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:00.838003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAB] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.838824] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CAC] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=21, ddl_arg=NULL) [2024-01-03 18:06:00.839495] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAD] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.840536] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CAE] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=37, ddl_arg=NULL) [2024-01-03 18:06:00.841332] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CAF] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:00.841968] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB0] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:00.842641] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB1] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.196886] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=29] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.196917] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=13] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.196933] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:01.198003] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E07F] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.198671] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E080] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.199297] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E081] [lt=90] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.199986] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E082] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.379810] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:01.379875] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:01.379889] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:01.434491] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:01.434541] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276360140739, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-629, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:01.434553] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:01.434645] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:01.434687] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276359442179, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1066, last_round_trip_time:938, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:01.434713] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:01.434734] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:01.434747] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:01.434807] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=19] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:01.435598] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=19] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:01.435791] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:01.436868] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:01.436880] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:01.437224] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:01.438569] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:01.438575] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:01.438747] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:01.438756] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:01.438763] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] start to process rs list update task [2024-01-03 18:06:01.438842] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=21] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:01.438854] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:06:01.440148] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:01.440179] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=15] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:01.440203] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:01.443217] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:01.443396] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:01.443422] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=22] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:01.443437] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:01.443460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D7] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:01.444984] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=73] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:01.460233] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF84] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.490669] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF84] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.490691] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF84] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.490703] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF84] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.490727] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF84] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.490864] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF84] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.490884] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF84] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.498394] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCD] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.499435] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BCE] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:01.499725] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF93] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.500189] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BCF] [lt=82] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.500860] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD0] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:01.501498] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD1] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.502457] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD2] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:01.503280] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD3] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:01.530464] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF93] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.530497] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF93] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.530508] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF93] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.530530] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF93] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.530600] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF4E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:01.530651] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF93] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.530664] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF93] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.562249] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF4E] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:01.562278] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF4E] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:01.562291] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF4E] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:01.562326] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF4E] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:01.562454] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF4E] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:01.562471] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF4E] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:01.685146] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:01.685162] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=12] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:01.889779] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:01.889787] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:01.889797] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=133) [2024-01-03 18:06:01.889804] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:01.889811] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:01.889817] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=552071430) [2024-01-03 18:06:01.889839] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:01.889846] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DF6F] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:01.889870] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DF70] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:01.890017] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DF70] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:02.141872] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:02.141909] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:02.141920] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994467] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:02.141937] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994467] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:02.382533] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:02.382546] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:02.382555] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:02.437308] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=67] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:02.437375] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276361443359, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:933, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:02.437395] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:02.437440] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:02.437482] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276362141842, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-678, last_round_trip_time:918, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:02.437514] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:02.491095] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF71] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.521060] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF71] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.521110] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF71] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.521125] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF71] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.521160] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF71] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.521310] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF71] [lt=32] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.521326] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF71] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.530834] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF87] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.562224] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:02.562258] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=30] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:02.562270] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:02.562297] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7C] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:06:02.564578] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF87] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.564612] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF87] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.564625] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF87] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.564658] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF87] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.564727] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF51] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:02.564789] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF87] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.564814] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF87] [lt=16] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.593419] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF51] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:02.593454] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF51] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:02.593464] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF51] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:02.593486] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF51] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:02.593608] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF51] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:02.593621] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF51] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:02.843597] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB2] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.844500] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB3] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:02.845453] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB4] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.846324] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB5] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:02.847188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB6] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:02.847863] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CB7] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:02.848440] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CB8] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.201010] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E083] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.201531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E084] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.202212] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E085] [lt=78] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.202708] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E086] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.385310] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:03.385341] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:03.385350] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:03.439985] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:03.440034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276361443359, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:933, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:03.440056] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:03.440435] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:03.440478] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276362141842, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-678, last_round_trip_time:918, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:03.440505] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:03.444525] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:03.444599] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:03.444611] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:03.444627] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=133, ddl_arg=NULL) [2024-01-03 18:06:03.504776] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF2-00060E079EC94BD4] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.505771] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD5] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:03.506421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.507560] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD7] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:03.508428] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BD8] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.509150] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BD9] [lt=67] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:03.509867] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BDA] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:03.521469] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF52] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.548875] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF52] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.548911] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF52] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.548921] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF52] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.548944] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF52] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.549119] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF52] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.549141] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF52] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:03.565052] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.594471] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF98] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.594507] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF98] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.594516] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF98] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.594539] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.594613] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:03.594687] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF98] [lt=60] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.594700] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF98] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:03.624416] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:03.624450] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF74] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:03.624460] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF74] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:03.624483] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF74] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:03.624581] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF74] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:03.624593] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF74] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.143044] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:04.143103] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=55] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:04.143162] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994468] [lt=55] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:04.143179] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994468] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=189, ddl_arg=NULL) [2024-01-03 18:06:04.327308] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428449] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:04.388041] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:04.388071] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:04.388081] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:04.442348] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:04.442400] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276363444496, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-968, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:04.442440] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:04.442853] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:04.442895] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276364142994, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-598, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:04.442919] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=20] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:04.549292] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF75] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.563658] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=39] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:04.563698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:04.563709] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:04.563727] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7D] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:04.578857] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF75] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.578895] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF75] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.578905] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF75] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.578929] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF75] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.579054] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF75] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.579067] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF75] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.594920] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.622522] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.622539] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF8C] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.622548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF8C] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.622571] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF8C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.622679] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF8C] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.622694] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF8C] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.624742] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF55] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:04.652093] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF55] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:04.652131] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF55] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:04.652141] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF55] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:04.652163] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF55] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:04.652263] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF55] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:04.652276] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF55] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:04.970128] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF5] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:04.984356] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBA] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.985132] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBB] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:04.985709] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBC] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.986346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBD] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:04.986909] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CBE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:04.987367] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CBF] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:04.987857] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.203661] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E087] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204129] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E088] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204486] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E089] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.204871] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08A] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.391110] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=33] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:05.391149] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:05.391164] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:05.445031] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=115] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:05.445115] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276363444496, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-968, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:05.445145] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:05.445392] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:05.445459] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276364142994, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-598, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:05.445486] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:05.445507] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:05.445547] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=32] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:05.445628] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=42] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:05.445755] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:05.445793] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:05.445809] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:05.445827] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284D9] [lt=9] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:05.446308] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=23] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:05.446494] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:05.447413] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:05.447421] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:05.447605] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:05.448394] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=20] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:05.448404] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:05.448587] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:05.448608] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=18] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:05.448616] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:05.448775] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=24] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:05.448784] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=8] [dc=0] broadcast root address succeed [2024-01-03 18:06:05.450046] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:05.450098] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:05.450116] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=15] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:05.452353] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:05.453805] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:05.579208] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF56] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:05.644204] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BDF] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:05.644678] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE0] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.645207] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE1] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:05.645684] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE2] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:05.651479] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DF9D] [lt=17] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:05.651516] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DF9D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:05.651527] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DF9D] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:05.651551] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DF9D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:05.651717] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DF9D] [lt=84] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:05.651733] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DF9D] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:05.652418] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:05.661115] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:05.661125] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:05.679638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF78] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:05.679656] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF78] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:05.679665] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF78] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:05.679688] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:05.679795] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF78] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:05.679807] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF78] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:05.846260] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=12] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:05.846268] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:05.846280] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=134) [2024-01-03 18:06:05.846291] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=9] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:05.846299] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:05.846306] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=556027918) [2024-01-03 18:06:05.846332] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:05.846339] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF90] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:05.846364] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF91] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:05.846487] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF91] [lt=18] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:06.144289] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:06.144310] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=18] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:06.144321] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994469] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:06.144337] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994469] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=83, ddl_arg=NULL) [2024-01-03 18:06:06.198267] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.198334] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=45] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.198352] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:06.393761] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:06.393788] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:06.393840] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=49] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:06.447504] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:06.447567] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276365445724, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-960, last_round_trip_time:921, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:06.447580] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:06.447760] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:06.447802] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276366144256, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:06.447827] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:06.564557] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:06.564597] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:06.564609] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:06.564626] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7E] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:06.609269] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF92] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.638862] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF92] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.638898] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF92] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.638908] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF92] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.638931] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF92] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.639070] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF92] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.639087] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF92] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.651940] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.678691] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.678735] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF59] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.678744] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF59] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.678768] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF59] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.678869] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF59] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.678882] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF59] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.679988] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA0] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:06.707801] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:06.707838] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA0] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:06.707853] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA0] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:06.707877] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:06.708000] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA0] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:06.708015] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:06.988869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC1] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.989717] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC2] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:06.990351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC3] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.990917] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC4] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:06.991460] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:06.991934] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC6] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:06.992378] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC7] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.205718] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08C] [lt=62] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.206265] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08D] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.206650] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08E] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.207024] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E08F] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.396376] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:07.396405] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:07.396432] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:07.446880] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:07.446911] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=28] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:07.446922] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:07.446980] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DA] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=132, ddl_arg=NULL) [2024-01-03 18:06:07.449888] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:07.449939] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276367446849, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1005, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:07.449974] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:07.450026] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:07.450068] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276366144256, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-720, last_round_trip_time:905, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:07.450100] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:07.639248] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.646690] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE3] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.647529] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE4] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:07.648363] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.648965] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE6] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:07.649486] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE7] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.649989] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BE8] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:07.650445] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BE9] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:07.670055] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.670074] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA1] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.670083] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.670106] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.670206] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA1] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.670220] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:07.679045] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF7D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.707000] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF7D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.707035] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF7D] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.707045] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF7D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.707068] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF7D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.707170] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF7D] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.707183] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF7D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:07.708161] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:07.734638] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:07.734675] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF95] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:07.734685] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF95] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:07.734708] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF95] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:07.734810] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF95] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:07.734824] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF95] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.145402] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=9] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:08.145441] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:08.145453] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:08.145470] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:08.398833] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:08.398864] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:08.398874] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:08.452980] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=56] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:08.453012] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:08.453031] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276367446849, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1005, last_round_trip_time:948, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:08.453044] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:08.453054] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276368145370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-695, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:08.453066] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:08.565400] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:08.565435] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:08.565445] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:08.565460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB7F] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:08.670393] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF96] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.702504] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF96] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.702540] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF96] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.702550] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF96] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.702583] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF96] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.702707] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF96] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.702721] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF96] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.707321] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF5E] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.737538] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF5E] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.737565] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF5E] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.737581] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF5E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.737605] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF5E] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.737721] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA4] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:08.737803] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF5E] [lt=73] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.737817] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF5E] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.768663] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA4] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:08.768697] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA4] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:08.768707] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:08.768730] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:08.768827] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA4] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:08.768839] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA4] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:08.993416] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CC8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.994192] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CC9] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:08.994774] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCA] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.995364] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CCB] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:08.996046] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCC] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:08.996743] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CCD] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:08.997418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CCE] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.208013] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E090] [lt=81] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.208580] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E091] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.209054] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E092] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.209674] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E093] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.328157] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844A] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:09.401340] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:09.401371] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:09.401385] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:09.447940] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:09.447987] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:09.447998] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:09.448015] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:06:09.455419] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:09.455471] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276368145370, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-695, last_round_trip_time:904, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:09.455484] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:09.455629] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:09.455705] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276369447911, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-978, last_round_trip_time:956, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:09.455725] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:09.455743] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:09.455757] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:09.455802] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=11] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:09.456836] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=54] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:09.457274] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=63] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:09.458406] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:09.458436] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=27] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:09.458773] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=30] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:09.459804] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=30] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:09.459815] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:09.460170] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:09.460208] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=34] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:09.460220] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:09.460327] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=19] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:09.460362] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=32] [dc=0] broadcast root address succeed [2024-01-03 18:06:09.462281] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=9] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:09.462353] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=50] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:09.462368] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:09.465630] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=21] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:09.469390] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=56] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:09.651423] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEA] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.652172] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BEB] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:09.653158] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEC] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.654026] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BED] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:09.654813] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BEE] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.655597] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BEF] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:09.656289] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF0] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:09.702877] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.735849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.735885] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA5] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.735899] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA5] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.735937] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA5] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.736119] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA5] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.736135] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA5] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.737935] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.741030] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:09.741041] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:09.771849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.771896] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF82] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.771911] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF82] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.771938] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF82] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.772064] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF82] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.772077] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF82] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.772050] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF61] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:09.803413] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF61] [lt=26] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:09.803454] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF61] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:09.803464] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF61] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:09.803487] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF61] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:09.803575] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF61] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:09.803587] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF61] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:09.944841] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=21] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:09.944850] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:09.944860] ERROR [RS] update_fail_count (ob_root_service.cpp:11445) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=135) BACKTRACE:0x9786d2e 0x96d9aa1 0x2262976 0x22625bb 0x2262333 0x235369a 0x69c1535 0x69ce13f 0x69cbbba 0x69fe88f 0x9710fb8 0x971555d 0x9714f8e 0x32f01cf 0x2bf4284 0x95718e5 0x9570572 0x956d09f [2024-01-03 18:06:09.944878] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=17] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:09.944885] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:09.944891] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=560126504) [2024-01-03 18:06:09.944909] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:09.944921] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DF9A] [lt=11] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:09.944961] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DF9B] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:09.945070] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DF9B] [lt=7] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:09.970765] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF6] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:10.146633] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=21] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:10.146672] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:10.146683] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:10.146700] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=129, ddl_arg=NULL) [2024-01-03 18:06:10.404102] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=26] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:10.404136] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:10.404154] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:10.457815] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:10.457866] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276370146575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-607, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:10.457879] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:10.458263] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:10.458305] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276369447911, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-978, last_round_trip_time:956, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:10.458324] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:10.566240] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:10.566280] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:10.566291] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:10.566308] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB80] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:10.694106] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D0] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:10.736291] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF9C] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.767768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF9C] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.767801] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF9C] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.767811] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF9C] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.767836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF9C] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.767934] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF9C] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.767965] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF9C] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.772217] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFA8] [lt=31] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.802519] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFA8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.802569] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFA8] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.802584] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFA8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.802608] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFA8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.802715] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFA8] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.802732] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFA8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.803746] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF85] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:10.834439] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF85] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:10.834484] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF85] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:10.834496] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF85] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:10.834533] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF85] [lt=13] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:10.834682] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF85] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:10.834700] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF85] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:10.998502] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD0] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:10.999166] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD1] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:10.999801] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD2] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.000372] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD3] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:11.001103] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD4] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.001652] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD5] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:11.002171] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD6] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.344063] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344121] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=36] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344138] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:11.344964] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E095] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.345388] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E096] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.345775] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E097] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.346169] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E098] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.406454] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:11.406487] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:11.406497] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:11.449250] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:11.449290] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:11.449301] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:11.449326] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DC] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=107, ddl_arg=NULL) [2024-01-03 18:06:11.460398] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=78] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:11.460454] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276370146575, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-607, last_round_trip_time:912, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:11.460473] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:11.460767] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:11.460853] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276371449219, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-817, last_round_trip_time:955, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:11.460880] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:11.657459] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF2] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.658124] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF3] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:11.658829] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF4] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.659455] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:11.660068] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.660602] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BF7] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:11.661128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF8] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:11.768103] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF86] [lt=17] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.796673] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF86] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.796716] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF86] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.796733] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF86] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.796768] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF86] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.796890] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF86] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.796903] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF86] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:11.802883] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF66] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.830509] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF66] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.830544] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF66] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.830554] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF66] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.830578] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF66] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.830735] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF66] [lt=82] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.830749] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF66] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:11.834867] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:11.862159] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DF9F] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:11.862192] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DF9F] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:11.862201] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DF9F] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:11.862225] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:11.862324] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DF9F] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:11.862337] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DF9F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.147988] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:12.148076] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=82] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:12.148093] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:12.148114] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=194, ddl_arg=NULL) [2024-01-03 18:06:12.408814] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:12.408844] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:12.408853] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:12.463467] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:12.463517] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276372147922, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-652, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:12.463589] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=67] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:12.464169] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=33] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:12.464230] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276371449219, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-817, last_round_trip_time:955, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:12.464265] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:12.567194] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=14] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:12.567246] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:12.567257] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:12.567277] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB81] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=114, ddl_arg=NULL) [2024-01-03 18:06:12.797095] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.826218] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.826263] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA0] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.826278] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA0] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.826303] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA0] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.826430] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA0] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.826443] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.830961] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.860599] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFAD] [lt=47] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.860636] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFAD] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.860646] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFAD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.860670] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.860757] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFAD] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.860769] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFAD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:12.862492] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF89] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:12.888328] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF89] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:12.888362] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF89] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:12.888371] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF89] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:12.888395] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF89] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:12.888522] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF89] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:12.888535] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF89] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.003088] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD7] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.003839] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CD8] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:13.004579] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CD9] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.005102] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CDA] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.005578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.006253] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CDC] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:13.006709] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDD] [lt=79] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.347035] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E099] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.347647] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.348074] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09B] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.348396] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09C] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.411278] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:13.411308] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:13.411317] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:13.450406] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=35] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:13.450469] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=59] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:13.450480] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:13.450522] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DD] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=148, ddl_arg=NULL) [2024-01-03 18:06:13.465985] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:13.466057] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=28] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276372147922, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-652, last_round_trip_time:915, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:13.466085] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:13.466817] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:13.466860] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276373450376, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-934, last_round_trip_time:960, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:13.466872] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:13.466892] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:13.466905] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:13.466966] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:13.467673] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=30] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:13.467869] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=22] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:13.469035] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=33] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:13.469042] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:13.469315] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=23] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:13.470910] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=11] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:13.470917] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:13.471107] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:13.471124] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=15] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:13.471132] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:13.471215] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=25] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:13.471223] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:06:13.472395] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:13.472454] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=43] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:13.472469] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=13] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:13.474767] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:13.476424] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=36] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:13.662147] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BF9] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.662940] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFA] [lt=48] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:13.663721] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFB] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.664372] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFC] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.664895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFD] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.665524] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94BFE] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:13.666128] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94BFF] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:13.698507] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:13.698522] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=11] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:13.826595] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF8A] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:13.889749] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:13.889786] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6B] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:13.889796] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6B] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:13.889819] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:13.889894] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:13.889920] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6B] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:13.889932] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6B] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.901264] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:13.901275] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:13.901287] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=136) [2024-01-03 18:06:13.901295] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:13.901303] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:13.901311] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=564082923) [2024-01-03 18:06:13.901343] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:13.901351] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFB1] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:13.917285] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA3] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:13.917320] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA3] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:13.917330] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:13.917353] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:13.917452] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA3] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:13.917465] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA3] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:13.917495] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DFA4] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:13.917651] INFO [RS] ob_update_rs_list_task.cpp:164 [1852][164][Y0-00060E079B34DFA4] [lt=21] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:14.149138] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:14.149177] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:14.149188] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:14.149203] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:14.329009] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844B] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:14.413639] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:14.413667] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:14.413676] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:14.468877] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=39] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:14.468940] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276374149108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-704, last_round_trip_time:920, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:14.468993] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=48] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:14.469138] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:14.469180] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276373450376, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-934, last_round_trip_time:960, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:14.469212] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:14.568164] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:14.568203] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:14.568214] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:14.568230] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB82] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:14.856434] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA5] [lt=21] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.883341] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.883375] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA5] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.883385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.883409] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.883508] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA5] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.883520] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.890129] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF8D] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.917512] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF8D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.917539] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF8D] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.917548] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF8D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.917571] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.917622] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF6E] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:14.917714] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF8D] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.917734] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF8D] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.947084] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6E] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:14.947121] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6E] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:14.947131] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6E] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:14.947154] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6E] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:14.947254] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6E] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:14.947267] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6E] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:14.971378] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF7] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:15.134990] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CDF] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.135711] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE0] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:15.136414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE1] [lt=70] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.137006] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE2] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:15.137555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE3] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.138165] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE4] [lt=20] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:15.138736] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE5] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.349163] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09D] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.349894] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09E] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.350463] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E09F] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.350982] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A0] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.416320] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:15.416335] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:15.416345] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:15.451366] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:15.451417] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=46] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:15.451435] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:15.451460] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284DE] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=139, ddl_arg=NULL) [2024-01-03 18:06:15.471561] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:15.471611] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276374149108, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-704, last_round_trip_time:920, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:15.471637] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:15.472049] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:15.472091] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276375451322, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1020, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:15.472103] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:15.694973] INFO [RS] ob_rs_rpc_processor.h:196 [2021][490][YB42C0A86EF2-00060E079EA943D1] [lt=40] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:15.796149] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94C01] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.796882] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C02] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:15.797525] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C03] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.798052] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C04] [lt=59] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:15.798524] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C05] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.799076] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C06] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:15.799638] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C07] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:15.883686] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.914009] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF6F] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.914047] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF6F] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.914058] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF6F] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.914081] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.914184] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF6F] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.914197] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF6F] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:15.917914] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFB6] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.946070] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFB6] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.946113] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFB6] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.946124] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFB6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.946147] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFB6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.946247] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFB6] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.946260] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFB6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:15.947453] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:15.975449] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:15.975485] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA8] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:15.975499] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA8] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:15.975528] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:15.975676] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA8] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:15.975697] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA8] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:16.150156] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=32] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:16.150193] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:16.150205] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:16.150220] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446E] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:16.345617] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.345680] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=40] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.345697] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:16.418820] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:16.418849] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:16.418858] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:16.474424] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:16.474480] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276376150125, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-623, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:16.474526] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=40] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:16.474862] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:16.474907] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276375451322, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1020, last_round_trip_time:930, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:16.474918] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:16.568978] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:16.569026] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:16.569044] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:16.569067] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB83] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=138, ddl_arg=NULL) [2024-01-03 18:06:16.914339] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFA9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.947185] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFA9] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:16.947257] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFA9] [lt=67] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:16.947273] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFA9] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:16.947300] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFA9] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:16.947369] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF92] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.947399] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFA9] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:16.947413] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFA9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:16.977278] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF92] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:16.977327] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF92] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:16.977341] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF92] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:16.977372] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF92] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:16.977443] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF72] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:16.977597] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF92] [lt=94] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:16.977615] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF92] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.006882] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF72] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:17.006916] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF72] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:17.006925] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF72] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:17.006966] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF72] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:17.007066] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF72] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:17.007079] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF72] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.007100] INFO [RS] ob_root_service.cpp:2707 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=8] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:17.007118] INFO [RS] ob_root_service.cpp:5490 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:17.007191] INFO [RS] ob_root_service.cpp:6142 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=20] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:17.008191] INFO [RS] ob_root_service.cpp:2484 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=63] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:17.008373] INFO [RS] ob_root_service.cpp:6148 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:17.009710] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:17.009718] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:17.009929] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=42] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:17.010863] INFO [RS] ob_update_rs_list_task.cpp:56 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:17.010869] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:17.011061] INFO [RS] ob_root_service.cpp:6169 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:17.011084] INFO [RS] ob_root_service.cpp:5514 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:17.011092] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:17.011172] INFO [RS] ob_update_rs_list_task.cpp:141 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:17.011187] INFO [RS] ob_root_service.cpp:2581 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=14] [dc=0] broadcast root address succeed [2024-01-03 18:06:17.012610] INFO [RS] ob_freeze_info_manager.cpp:113 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:17.012669] INFO [RS] ob_freeze_info_manager.cpp:303 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:17.012680] INFO [RS] ob_root_service.cpp:5533 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:17.015094] INFO [RS] ob_root_service.cpp:5550 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:17.016561] INFO [RS] ob_root_service.cpp:5565 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:17.139870] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE6] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.140613] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE7] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:17.141436] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CE8] [lt=64] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.142193] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CE9] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:17.142878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEA] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.143906] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CEB] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:17.144905] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEC] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.273182] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:17.273193] WARN [RS] do_restart (ob_root_service.cpp:5579) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:17.352032] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A2] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.352766] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A3] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.353468] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A4] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.353932] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A5] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.452518] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284DF] [lt=12] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:17.522725] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=19] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:17.522736] WARN [RS] do_restart (ob_root_service.cpp:5586) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=8] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:17.522748] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=137) [2024-01-03 18:06:17.522756] INFO [RS] ob_root_service.cpp:5901 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:17.522764] WARN [RS] after_restart (ob_root_service.cpp:2717) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:17.522772] WARN [RS] after_restart (ob_root_service.cpp:2724) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=567704384) [2024-01-03 18:06:17.522804] INFO [RS] ob_root_service.cpp:2540 [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:17.522839] WARN [RS] process (ob_root_service.cpp:6243) [1853][166][YB42C0A86EF0-00060E079B14DF74] [lt=32] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:17.522870] INFO [RS] ob_update_rs_list_task.cpp:104 [1853][166][Y0-00060E079B14DF75] [lt=8] [dc=0] start to process rs list update task [2024-01-03 18:06:17.523034] INFO [RS] ob_update_rs_list_task.cpp:164 [1853][166][Y0-00060E079B14DF75] [lt=28] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:17.800843] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C08] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.801940] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C09] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:06:17.802942] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0A] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.804006] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C0B] [lt=68] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:17.805507] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0C] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.806867] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C0D] [lt=54] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:17.808004] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0E] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:17.947558] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBB] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:17.983796] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBB] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:17.983856] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBB] [lt=56] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:17.983870] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBB] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:17.983909] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBB] [lt=15] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:17.984093] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBB] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:17.984109] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBB] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:17.984134] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFAC] [lt=34] [dc=1] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:18.015920] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFAC] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:18.015982] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFAC] [lt=58] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:18.016012] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFAC] [lt=27] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:18.016046] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFAC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:18.016129] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF95] [lt=35] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:18.016200] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFAC] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:18.016218] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFAC] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:18.045742] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF95] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:18.045775] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF95] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:18.045786] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF95] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:18.045809] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF95] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:18.045908] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF95] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:18.045920] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF95] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:18.151230] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=41] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:18.151272] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:18.151283] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:18.151301] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99446F] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:18.424175] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=29] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:18.424206] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:18.424214] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:18.479475] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:18.479522] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276378151199, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-611, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:18.479533] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:18.479857] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:18.479896] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276377452488, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-905, last_round_trip_time:888, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:18.479920] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:18.569844] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:18.569880] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:18.569894] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:18.569910] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB84] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:06:18.984258] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF96] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.018372] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF96] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.018389] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF96] [lt=15] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.018398] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF96] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.018421] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF96] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.018515] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF78] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.018544] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF96] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.018562] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF96] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.048584] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF78] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.048659] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF78] [lt=71] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.048676] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF78] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.048709] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF78] [lt=14] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.048796] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:19.048870] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF78] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.048891] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF78] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.077796] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:19.077823] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBE] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:19.077832] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:19.077855] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:19.077975] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBE] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:19.077991] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBE] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:19.146164] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CED] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.147067] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CEE] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:19.148530] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CEF] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.149552] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF0] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:19.150448] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF1] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.151178] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF2] [lt=19] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:19.151911] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF3] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.329940] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844C] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:19.354771] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF0-00060E079A34E0A6] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.355499] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A7] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.356351] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0A8] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.362644] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF0-00060E079A34E0A9] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.426714] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=54] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:19.426727] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:19.426737] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:19.453644] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:19.453698] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:19.453714] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:19.453731] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E0] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=130, ddl_arg=NULL) [2024-01-03 18:06:19.482252] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=96] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:19.482304] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276378151199, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-611, last_round_trip_time:859, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:19.482317] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:19.482920] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:19.482992] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276379453604, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:19.483023] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:19.809401] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C0F] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.810332] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C10] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=41, ddl_arg=NULL) [2024-01-03 18:06:19.811578] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C11] [lt=46] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.812420] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C12] [lt=105] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:06:19.813053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C13] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.813651] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C14] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:19.814271] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C15] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:19.972120] INFO [RS] ob_rs_rpc_processor.h:196 [2021][490][YB42C0A86EF0-00060E079A24DAF8] [lt=17] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:20.018743] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFBF] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.049671] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFBF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.049705] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFBF] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.049715] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFBF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.049738] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFBF] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.049812] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB1] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.049860] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFBF] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.049872] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFBF] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.077666] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.077700] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB1] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.077710] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.077739] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB1] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.077844] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB1] [lt=31] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.077857] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.078160] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF99] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:20.108848] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF99] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:20.108892] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF99] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:20.108905] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF99] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:20.108929] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF99] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:20.109062] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF99] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:20.109075] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF99] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:20.152457] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:20.152533] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=71] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:20.152550] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994470] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:20.152573] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994470] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=181, ddl_arg=NULL) [2024-01-03 18:06:20.429244] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:20.429274] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:20.429283] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:20.485137] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=40] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:20.485217] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276380152394, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-564, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:20.485273] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=52] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:20.486421] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=34] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:20.486470] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276379453604, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-861, last_round_trip_time:873, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:20.486520] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=46] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:20.570753] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:20.570793] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:20.570804] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:20.570820] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB85] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:20.695775] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D2] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:21.050012] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF9A] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.077444] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF9A] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.077491] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF9A] [lt=44] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.077506] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF9A] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.077528] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF9A] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.077625] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF9A] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.077638] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF9A] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.078001] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF7D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.106550] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF7D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.106584] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF7D] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.106594] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF7D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.106617] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF7D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.106699] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF7D] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.106712] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF7D] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.109235] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFC2] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:21.137939] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFC2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:21.138011] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFC2] [lt=70] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:21.138022] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFC2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:21.138045] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFC2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:21.138163] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFC2] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:21.138180] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFC2] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:21.138209] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=11] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:21.138234] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=10] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:21.138305] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=14] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:21.139148] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=24] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:21.139437] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=37] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:21.140294] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:21.140306] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:21.140515] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:21.141485] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:21.141493] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:21.141687] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:21.141698] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:21.141706] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:21.141886] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=98] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:21.141896] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] broadcast root address succeed [2024-01-03 18:06:21.143382] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:21.143413] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=15] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:21.143424] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:21.145911] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:21.148306] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=102] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:21.152976] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF5] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.153587] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF6] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:21.154370] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF7] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.154909] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CF8] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:21.155456] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CF9] [lt=17] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.156009] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFA] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:21.156593] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CFB] [lt=14] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.378401] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:21.378410] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:21.431690] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:21.431721] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:21.431730] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:21.454708] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:21.454746] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:21.454758] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:21.454774] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E1] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:06:21.487991] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=71] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:21.504168] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AC] [lt=15] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.504561] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AD] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.504985] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AE] [lt=47] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.580431] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:21.580441] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:21.580452] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=138) [2024-01-03 18:06:21.580461] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:21.580468] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:21.580476] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=571762088) [2024-01-03 18:06:21.580495] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:21.580503] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFC4] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:21.580537] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFC5] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:21.580677] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFC5] [lt=20] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:21.815414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C17] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.816157] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C18] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:21.816733] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C19] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.817316] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:21.817860] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C1B] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:21.818392] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1C] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:21.818882] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C1D] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:22.077782] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB6] [lt=36] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.107115] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB6] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.107153] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB6] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.107163] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB6] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.107186] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.107249] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DF9D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.107287] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB6] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.107299] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.138120] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.138158] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DF9D] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.138168] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.138190] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DF9D] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.138311] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DF9D] [lt=33] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.138324] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DF9D] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.138343] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF80] [lt=41] [dc=1] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:22.153742] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:22.153758] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=14] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:22.153767] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994471] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:22.153782] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994471] [lt=6] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=67, ddl_arg=NULL) [2024-01-03 18:06:22.167111] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF80] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:22.167158] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF80] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:22.167168] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF80] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:22.167204] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF80] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:22.167337] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF80] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:22.167358] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF80] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:22.434352] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:22.434387] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:22.434399] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:22.490590] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:22.490639] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276382153716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-753, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:22.490660] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=17] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:22.492433] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:22.492502] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276381454679, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-912, last_round_trip_time:878, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:22.492540] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=33] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:22.571613] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:22.571668] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=49] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:22.571685] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:22.571706] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB86] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=135, ddl_arg=NULL) [2024-01-03 18:06:23.107467] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF81] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.138536] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF81] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.138575] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF81] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.138592] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF81] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.138626] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF81] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.138685] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFC8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.138776] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF81] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.138797] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF81] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.157564] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF1-00060E079C528CFC] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.158251] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFD] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:06:23.158878] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528CFE] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.159482] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528CFF] [lt=53] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:23.159976] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D00] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.160449] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D01] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:23.160923] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D02] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.165938] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFC8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.165972] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFC8] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.165981] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFC8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.166016] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFC8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.166103] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFC8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.166116] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFC8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.167538] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:23.194849] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFB9] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:23.194883] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFB9] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:23.194893] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFB9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:23.194917] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:23.195047] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFB9] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:23.195060] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFB9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:23.437006] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:23.437038] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:23.437047] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:23.455703] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:23.455754] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=45] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:23.455766] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:23.455783] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E2] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:23.493175] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:23.493226] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276382153716, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-753, last_round_trip_time:902, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:23.493256] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:23.494922] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:23.494994] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276383455660, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-964, last_round_trip_time:868, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:23.495024] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:23.505770] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0AF] [lt=11] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.506333] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B0] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.506834] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B1] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.507418] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B2] [lt=49] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.819842] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2016][480][YB42C0A86EF2-00060E079EC94C1E] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.820567] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C1F] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:23.821237] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C20] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.821835] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C21] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:23.822447] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C22] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:23.823031] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C23] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:23.823566] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C24] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:24.138981] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.154760] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:24.154817] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=53] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:24.154828] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994472] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:24.154844] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994472] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=121, ddl_arg=NULL) [2024-01-03 18:06:24.166908] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.166933] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFBA] [lt=24] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.166942] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFBA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.167057] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFBA] [lt=96] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.167116] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFA2] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.167201] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFBA] [lt=58] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.167214] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFBA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.197799] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFA2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.197833] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFA2] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.197843] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFA2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.197866] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFA2] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.197925] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:24.197999] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFA2] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.198011] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFA2] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.225266] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF84] [lt=18] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:24.225299] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF84] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:24.225309] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF84] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:24.225332] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:24.225426] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF84] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:24.225439] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF84] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:24.331091] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844D] [lt=30] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:24.439424] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:24.439466] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=34] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:24.439481] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:24.495900] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:24.496013] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276384154728, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-650, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:24.496048] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:24.497977] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=51] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:24.498021] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276383455660, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-964, last_round_trip_time:868, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:24.498042] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=16] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:24.572692] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:24.572730] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:24.572741] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:24.572758] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB87] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=99, ddl_arg=NULL) [2024-01-03 18:06:24.972936] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAF9] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.167383] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF85] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.198096] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF85] [lt=14] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.198143] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF85] [lt=43] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.198154] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF85] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.198178] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF85] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.198225] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFCD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.198280] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF85] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.198298] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF85] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.229540] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFCD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.229583] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFCD] [lt=40] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.229597] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFCD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.229631] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFCD] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.229701] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFBD] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:25.229790] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFCD] [lt=29] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.229809] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFCD] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.261635] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFBD] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:25.261661] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFBD] [lt=23] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:25.261674] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFBD] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:25.261706] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFBD] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:25.261818] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFBD] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:25.261830] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFBD] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:25.261850] INFO [RS] ob_root_service.cpp:2707 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:25.261867] INFO [RS] ob_root_service.cpp:5490 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:25.261910] INFO [RS] ob_root_service.cpp:6142 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:25.262608] INFO [RS] ob_root_service.cpp:2484 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=11] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:25.262842] INFO [RS] ob_root_service.cpp:6148 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=9] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:25.263764] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=17] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:25.263776] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:25.264131] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=18] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:25.265180] INFO [RS] ob_update_rs_list_task.cpp:56 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=35] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:25.265191] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:25.265477] INFO [RS] ob_root_service.cpp:6169 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:25.265507] INFO [RS] ob_root_service.cpp:5514 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=27] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:25.265519] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=9] [dc=0] start to process rs list update task [2024-01-03 18:06:25.265619] INFO [RS] ob_update_rs_list_task.cpp:141 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=29] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:25.265646] INFO [RS] ob_root_service.cpp:2581 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=25] [dc=0] broadcast root address succeed [2024-01-03 18:06:25.267122] INFO [RS] ob_freeze_info_manager.cpp:113 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:25.267181] INFO [RS] ob_freeze_info_manager.cpp:303 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=42] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:25.267205] INFO [RS] ob_root_service.cpp:5533 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=22] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:25.269691] INFO [RS] ob_root_service.cpp:5550 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=8] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:25.271286] INFO [RS] ob_root_service.cpp:5565 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=41] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:25.307203] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D04] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.307913] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D05] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=19, ddl_arg=NULL) [2024-01-03 18:06:25.308596] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D06] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.309295] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D07] [lt=73] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.310304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D08] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.311078] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D09] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.311806] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0A] [lt=41] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.442566] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=30] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:25.442596] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:25.442605] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:25.456891] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:25.456910] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=17] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:25.456921] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:25.456938] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E3] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=80, ddl_arg=NULL) [2024-01-03 18:06:25.498839] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:25.498897] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276384154728, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-650, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:25.498934] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=31] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:25.500800] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:25.500885] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276385456860, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:855, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:25.500926] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:25.508255] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B3] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.508895] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B4] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.509437] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B5] [lt=83] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.509864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B6] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.586119] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:25.586129] WARN [RS] do_restart (ob_root_service.cpp:5579) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:25.696651] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D3] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:25.794276] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:25.794286] WARN [RS] do_restart (ob_root_service.cpp:5586) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:25.794294] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=139) [2024-01-03 18:06:25.794300] INFO [RS] ob_root_service.cpp:5901 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:25.794305] WARN [RS] after_restart (ob_root_service.cpp:2717) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=3] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:25.794310] WARN [RS] after_restart (ob_root_service.cpp:2724) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=575975923) [2024-01-03 18:06:25.794326] INFO [RS] ob_root_service.cpp:2540 [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:25.794333] WARN [RS] process (ob_root_service.cpp:6243) [1852][164][YB42C0A86EF0-00060E079B34DFBF] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:25.794363] INFO [RS] ob_update_rs_list_task.cpp:104 [1852][164][Y0-00060E079B34DFC0] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:25.981782] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2015][478][YB42C0A86EF2-00060E079EC94C26] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.982757] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C27] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=29, ddl_arg=NULL) [2024-01-03 18:06:25.983457] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C28] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.984240] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C29] [lt=15] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=28, ddl_arg=NULL) [2024-01-03 18:06:25.984816] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2A] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:25.985461] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C2B] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:25.986050] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2C] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:26.156060] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=26] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:26.156101] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:26.156113] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994473] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:26.156130] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994473] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:06:26.198429] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFA7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.229024] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFA7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.229072] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFA7] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.229087] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFA7] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.229122] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFA7] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.229257] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFA7] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.229275] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFA7] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.229999] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF88] [lt=14] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.262866] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF88] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.262893] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF88] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.262902] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF88] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.262941] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF88] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.263025] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD0] [lt=25] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:26.263063] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF88] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.263075] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF88] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.292768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD0] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:26.292803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD0] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:26.292819] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD0] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:26.292852] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:26.292969] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD0] [lt=35] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:26.292983] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:26.445282] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:26.445311] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:26.445320] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:26.503591] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=38] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:26.503691] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=34] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276386156027, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-510, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:26.503744] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=47] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:26.504134] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:26.504187] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276385456860, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:855, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:26.504199] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:26.505049] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=6] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.505109] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=31] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.505133] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:26.573829] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:26.573903] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=40] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:26.573922] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:26.573943] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB88] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=154, ddl_arg=NULL) [2024-01-03 18:06:27.229542] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD1] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.263079] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD1] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.263117] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.263128] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD1] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.263152] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.263250] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD1] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.263263] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.263230] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.291466] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFC3] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.291502] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFC3] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.291512] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFC3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.291535] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.291633] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFC3] [lt=21] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.291646] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFC3] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.293123] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAA] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:27.312795] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0B] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.313532] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D0C] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:27.314372] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D0D] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.315388] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D0E] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:27.316277] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2017][482][YB42C0A86EF1-00060E079C528D0F] [lt=54] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.317027] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D10] [lt=46] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:27.317636] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D11] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.323249] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:27.323289] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAA] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:27.323299] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:27.323329] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:27.323457] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAA] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:27.323475] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAA] [lt=11] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:27.448416] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:27.448444] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:27.448453] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:27.458162] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=30] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:27.458201] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:27.458217] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:27.458237] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E4] [lt=10] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:06:27.506669] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:27.506744] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276386156027, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-510, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:27.506764] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:27.507061] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:27.507164] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=45] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276387458106, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-821, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:27.507196] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=27] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:27.510706] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B8] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.511471] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0B9] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.511988] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BA] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.512547] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.987177] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C2D] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.988123] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C2E] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:27.988905] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF2-00060E079EC94C2F] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.989582] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C30] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:27.990249] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C31] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:27.990962] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C32] [lt=42] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:27.991607] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C33] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:28.157115] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:28.157154] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:28.157166] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994474] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:28.157183] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994474] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:28.263405] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAB] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.294546] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.294564] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAB] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.294574] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.294596] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.294687] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF8D] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.294765] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAB] [lt=69] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.294783] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAB] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.322527] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF8D] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.322562] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF8D] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.322576] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF8D] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.322599] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF8D] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.322692] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF8D] [lt=17] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.322704] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF8D] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.323615] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:28.353278] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD4] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:28.353301] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD4] [lt=21] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:28.353314] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD4] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:28.353337] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:28.353440] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD4] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:28.353452] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD4] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:28.450833] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:28.450861] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:28.450870] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:28.509232] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=55] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:28.509283] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276388157084, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:28.509331] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:28.509464] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:28.509506] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276387458106, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-821, last_round_trip_time:865, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:28.509532] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:28.574833] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:28.574867] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=31] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:28.574880] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=11] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:28.574897] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB89] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:29.294927] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD5] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.318577] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D12] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.319498] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D13] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=20, ddl_arg=NULL) [2024-01-03 18:06:29.320267] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D14] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.320993] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D15] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:29.321570] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D16] [lt=75] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.322106] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D17] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:29.322697] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D18] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.325378] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD5] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.325405] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD5] [lt=25] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.325415] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD5] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.325438] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD5] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.325505] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.325546] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD5] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.325559] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD5] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.332013] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844E] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=12, ddl_arg=NULL) [2024-01-03 18:06:29.352325] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFC8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.352373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFC8] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.352383] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFC8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.352407] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.352496] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFC8] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.352509] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFC8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.353597] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFAE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:29.380432] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFAE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:29.380469] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFAE] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:29.380478] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFAE] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:29.380501] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFAE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:29.380601] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFAE] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:29.380614] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFAE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:29.380634] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:29.380652] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:29.380696] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=6] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:29.381377] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=27] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:29.381574] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:29.382487] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=16] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:29.382500] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=11] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:29.382802] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:29.383700] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:29.383711] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=9] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:29.384095] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=14] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:29.384112] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=13] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:29.384141] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=25] [dc=0] start to process rs list update task [2024-01-03 18:06:29.384281] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=30] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:29.384294] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=11] [dc=0] broadcast root address succeed [2024-01-03 18:06:29.386248] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=8] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:29.386311] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=40] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:29.386344] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=30] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:29.388869] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=10] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:29.390480] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=42] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:29.453612] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:29.453644] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=26] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:29.453655] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:29.459359] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:29.459395] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=33] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:29.459406] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:29.459422] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E5] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=91, ddl_arg=NULL) [2024-01-03 18:06:29.512253] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:29.512313] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=16] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276388157084, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-659, last_round_trip_time:883, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:29.512326] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:29.512363] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:29.512425] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276389459332, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-974, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:29.512464] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:29.513435] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BC] [lt=39] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514031] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BD] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BE] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.514937] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0BF] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.636240] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=17] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:29.636281] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=34] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:29.829560] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:29.829568] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:29.829578] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=140) [2024-01-03 18:06:29.829584] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:29.829590] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:29.829596] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=580011209) [2024-01-03 18:06:29.829617] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=4] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:29.829623] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFB0] [lt=5] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:29.973657] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFA] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:29.992617] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C34] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.993311] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C35] [lt=14] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:29.993913] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C36] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.994459] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C37] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:29.995027] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C38] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:29.995591] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C39] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:29.996047] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3A] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:30.026872] INFO [RS] ob_backup_lease_service.cpp:276 [1882][224][Y0-0000000000000000] [lt=32] [dc=0] do idle(idle_us=60000000, can_be_leader_ts_=0, expect_round_=0, lease_info_={is_leader:false, lease_start_ts:0, leader_epoch:0, leader_takeover_ts:0, round:0}) [2024-01-03 18:06:30.158174] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:30.158214] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:30.158249] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994475] [lt=32] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:30.158266] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994475] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:06:30.325709] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.357555] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF92] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.357589] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF92] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.357599] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF92] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.357623] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.357686] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFD8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.357726] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF92] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.357739] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF92] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.387630] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFD8] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.387699] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFD8] [lt=63] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.387717] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFD8] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.387755] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFD8] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.387881] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:30.388006] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFD8] [lt=65] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.388031] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFD8] [lt=14] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.417036] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:30.417073] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFCB] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:30.417083] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFCB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:30.417105] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFCB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:30.417228] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFCB] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:30.417242] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFCB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:30.456424] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:30.456455] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:30.456464] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:30.514775] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:30.514825] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276389459332, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-974, last_round_trip_time:897, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:30.514861] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:30.515165] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:30.515229] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276390158143, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-657, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:30.515242] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:30.575589] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=19] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:30.575630] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:30.575641] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:30.575658] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8A] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:30.697487] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D4] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:31.323712] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D1A] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.324535] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1B] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=22, ddl_arg=NULL) [2024-01-03 18:06:31.325113] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2019][486][YB42C0A86EF1-00060E079C528D1C] [lt=21] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.325716] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1D] [lt=39] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:31.326300] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D1E] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.326897] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D1F] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:31.327363] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D20] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.357905] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.391200] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFCC] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.391222] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFCC] [lt=20] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.391231] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFCC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.391255] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.391333] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.391377] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFCC] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.391390] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFCC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.418768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB4] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.418803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB4] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.418814] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB4] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.418849] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB4] [lt=12] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.418911] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDB] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:31.418993] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB4] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.419006] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.444888] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDB] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:31.444921] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDB] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:31.444931] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:31.444991] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDB] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:31.445083] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDB] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:31.445096] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:31.458742] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:31.458770] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:31.458779] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:31.460468] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:31.460507] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=23] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:31.460518] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:31.460534] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E6] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=136, ddl_arg=NULL) [2024-01-03 18:06:31.517840] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=14] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:31.517890] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276390158143, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-657, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:31.517906] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=11] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:31.518113] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:31.518157] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276391460401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-944, last_round_trip_time:894, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:31.518182] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:31.673453] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=32] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.673530] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=43] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.673576] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=30] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:31.674585] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C1] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.675151] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C2] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.675641] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C3] [lt=53] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.676080] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C4] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.996935] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3C] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.997729] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C3D] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:31.998397] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C3E] [lt=76] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.999068] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C3F] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:31.999568] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C40] [lt=43] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:31.999978] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C41] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:32.000485] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C42] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:32.159262] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:32.159301] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:32.159317] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994476] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:32.159332] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994476] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:32.391528] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.423001] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDC] [lt=32] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.423038] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDC] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.423048] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDC] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.423070] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDC] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.423125] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DF97] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.423164] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDC] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.423178] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDC] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.452156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.452195] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DF97] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.452240] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DF97] [lt=43] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.452264] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.452322] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB7] [lt=17] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:32.452418] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DF97] [lt=60] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.452432] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DF97] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.461317] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:32.461340] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=18] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:32.461349] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:32.480932] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB7] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:32.481008] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB7] [lt=71] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:32.481021] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB7] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:32.481051] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB7] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:32.481142] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB7] [lt=18] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:32.481154] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB7] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:32.520653] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:32.520704] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276391460401, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-944, last_round_trip_time:894, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:32.520740] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=32] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:32.521035] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:32.521125] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276392159231, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:32.521169] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=37] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:32.576525] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:32.576591] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=62] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:32.576602] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:32.576619] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:33.328336] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF1-00060E079C528D21] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.329038] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D22] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:33.329884] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D23] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.330569] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D24] [lt=36] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:33.331124] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D25] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.331601] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D26] [lt=43] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:33.332197] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D27] [lt=12] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.423291] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD1] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.455664] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD1] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.455692] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD1] [lt=26] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.455701] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.455725] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.455805] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFB8] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.455847] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD1] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.455867] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD1] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.461762] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:33.461799] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:33.461810] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:33.461826] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E7] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=125, ddl_arg=NULL) [2024-01-03 18:06:33.463893] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=34] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:33.463927] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:33.463937] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:33.485156] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFB8] [lt=11] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.485195] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFB8] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.485205] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFB8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.485232] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFB8] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.485314] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFDF] [lt=10] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:33.485401] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFB8] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.485415] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFB8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.485456] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=16] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:33.485481] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=11] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:33.485575] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=16] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:33.486590] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:33.486833] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:33.487823] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:33.487831] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:33.488049] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=46] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:33.489032] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=24] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:33.489043] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=10] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:33.489227] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=19] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:33.489247] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=18] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:33.489255] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:33.489333] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=20] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:33.489347] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=13] [dc=0] broadcast root address succeed [2024-01-03 18:06:33.490610] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:33.490666] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=39] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:33.490689] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=21] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:33.493015] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:33.494430] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:33.516152] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFDF] [lt=21] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:33.516202] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFDF] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:33.516217] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFDF] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:33.516248] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFDF] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:33.516351] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFDF] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:33.516364] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFDF] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:33.523366] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:33.523379] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:33.523414] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276392159231, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-797, last_round_trip_time:870, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:33.523420] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276393461704, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-842, last_round_trip_time:885, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:33.523426] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:33.523433] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:33.676908] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C5] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.677414] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C6] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.678051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C7] [lt=48] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.678603] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C8] [lt=69] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:33.715484] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:33.715494] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:33.893197] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=11] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:33.893207] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=6] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:33.893217] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=141) [2024-01-03 18:06:33.893224] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:33.893230] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=4] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:33.893236] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=584074849) [2024-01-03 18:06:33.893261] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=5] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:33.893275] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFBA] [lt=12] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:33.893298] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DFBB] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:33.893409] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DFBB] [lt=6] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:34.002272] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C44] [lt=23] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:34.002869] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C45] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.003481] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C46] [lt=45] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:34.004062] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C47] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.004538] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C48] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:34.005081] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C49] [lt=20] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:34.160304] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:34.160340] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:34.160350] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994477] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:34.160366] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994477] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=93, ddl_arg=NULL) [2024-01-03 18:06:34.332858] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C42844F] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:34.456075] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE0] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.466706] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:34.466735] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:34.466745] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:34.488092] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE0] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.488146] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE0] [lt=50] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.488161] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.488198] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE0] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.488285] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.488329] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE0] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.488343] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE0] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.518211] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD4] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.518249] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD4] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.518259] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.518293] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD4] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.518374] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFBC] [lt=18] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:34.518448] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD4] [lt=20] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.518467] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD4] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.526104] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=19] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:34.526164] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=25] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:34.526197] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276394160277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-717, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:34.526206] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276393461704, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-842, last_round_trip_time:885, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:34.526219] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:34.526219] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:34.551040] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFBC] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:34.551080] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFBC] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:34.551090] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFBC] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:34.551115] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFBC] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:34.551212] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFBC] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:34.551226] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFBC] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:34.577535] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:34.577572] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:34.577583] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:34.577600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:34.974355] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFB] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:35.459107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D29] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.459698] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2A] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=26, ddl_arg=NULL) [2024-01-03 18:06:35.460270] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2B] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.460932] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2C] [lt=44] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:35.461460] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2D] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.461939] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D2E] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:35.462451] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D2F] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.462974] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:35.463006] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=29] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:35.463016] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=8] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:35.463032] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E8] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=110, ddl_arg=NULL) [2024-01-03 18:06:35.469398] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:35.469426] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=23] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:35.469436] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:35.488494] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.519900] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.519934] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE3] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.519944] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE3] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.519987] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE3] [lt=26] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.520062] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFA2] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.520161] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE3] [lt=76] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.520177] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE3] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.528488] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:35.528540] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276395462926, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1015, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:35.528552] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:35.528657] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=29] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:35.528699] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276394160277, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-717, last_round_trip_time:851, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:35.528725] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:35.553197] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFA2] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.553241] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFA2] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.553251] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFA2] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.553274] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFA2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.553361] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:35.553459] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFA2] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.553474] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFA2] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.583283] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE4] [lt=24] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:35.583301] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:35.583311] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:35.583336] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:35.583445] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE4] [lt=16] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:35.583467] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE4] [lt=12] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:35.679371] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0C9] [lt=10] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.679859] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CA] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.680324] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2006][460][YB42C0A86EF0-00060E079A34E0CB] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.680747] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CC] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:35.698314] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D5] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:36.139713] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4B] [lt=30] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.140471] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C4C] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=17, ddl_arg=NULL) [2024-01-03 18:06:36.141258] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4D] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.141937] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C4E] [lt=38] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:36.142556] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C4F] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.143164] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C50] [lt=51] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:36.143751] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C51] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:36.161319] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=15] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:36.161373] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=48] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:36.161389] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994478] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:36.161406] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994478] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=123, ddl_arg=NULL) [2024-01-03 18:06:36.471936] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:36.471985] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=43] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:36.471995] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:36.520343] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFD9] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.531283] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:36.531337] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=11] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:36.531337] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276396161288, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-768, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:36.531350] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:36.531394] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276395462926, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-1015, last_round_trip_time:896, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:36.531414] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:36.552426] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFD9] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.552464] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFD9] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.552474] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFD9] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.552500] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFD9] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.552609] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFD9] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.552632] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFD9] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.553620] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFC1] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.578431] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=33] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:36.578471] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:36.578483] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:36.578501] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=105, ddl_arg=NULL) [2024-01-03 18:06:36.583573] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFC1] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.583624] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFC1] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.583641] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFC1] [lt=15] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.583673] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFC1] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.583756] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:36.583796] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFC1] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.583809] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFC1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.615493] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE7] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:36.615512] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE7] [lt=17] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:36.615521] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:36.615545] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:36.615656] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE7] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:36.615670] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:36.674975] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=67] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:36.675037] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=37] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:36.675053] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:37.463466] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D30] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.463850] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:37.463885] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=32] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:37.463894] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:37.463911] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284E9] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=94, ddl_arg=NULL) [2024-01-03 18:06:37.464366] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D31] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:37.464898] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D32] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.465457] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D33] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:37.466051] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D34] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.466603] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D35] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:37.467110] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D36] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.474527] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=23] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:37.474557] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:37.474567] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:37.533880] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:37.533891] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:37.533940] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276396161288, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-768, last_round_trip_time:861, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:37.533970] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276397463821, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-973, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:37.533974] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:37.533983] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:37.534004] INFO [RS] ob_root_service.cpp:2707 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:37.534018] INFO [RS] ob_root_service.cpp:5490 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:37.534065] INFO [RS] ob_root_service.cpp:6142 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:37.534934] INFO [RS] ob_root_service.cpp:2484 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=28] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:37.535158] INFO [RS] ob_root_service.cpp:6148 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:37.536068] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=12] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:37.536083] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:37.536296] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:37.537139] INFO [RS] ob_update_rs_list_task.cpp:56 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=9] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:37.537147] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:37.537335] INFO [RS] ob_root_service.cpp:6169 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:37.537359] INFO [RS] ob_root_service.cpp:5514 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=21] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:37.537370] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:37.537455] INFO [RS] ob_update_rs_list_task.cpp:141 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:37.537478] INFO [RS] ob_root_service.cpp:2581 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=20] [dc=0] broadcast root address succeed [2024-01-03 18:06:37.539254] INFO [RS] ob_freeze_info_manager.cpp:113 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:37.539340] INFO [RS] ob_freeze_info_manager.cpp:303 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=56] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:37.539370] INFO [RS] ob_root_service.cpp:5533 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=27] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:37.542196] INFO [RS] ob_root_service.cpp:5550 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=13] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:37.543920] INFO [RS] ob_root_service.cpp:5565 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=39] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:37.552798] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.584346] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.584384] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFE8] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.584394] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFE8] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.584416] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFE8] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.584481] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFA7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.584519] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFE8] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.584533] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFE8] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.616099] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFA7] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.616123] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFA7] [lt=22] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.616132] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFA7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.616155] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFA7] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.616265] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFA7] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.616280] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFA7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.616233] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFDC] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:37.645713] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFDC] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:37.645755] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFDC] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:37.645770] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFDC] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:37.645805] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFDC] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:37.645966] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFDC] [lt=48] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:37.645994] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFDC] [lt=20] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:37.681757] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CE] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.682342] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0CF] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.682882] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D0] [lt=73] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.683397] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D1] [lt=22] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:37.792893] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:37.792904] WARN [RS] do_restart (ob_root_service.cpp:5579) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:38.005259] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:38.005279] WARN [RS] do_restart (ob_root_service.cpp:5586) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=16] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:38.005292] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=142) [2024-01-03 18:06:38.005301] INFO [RS] ob_root_service.cpp:5901 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=8] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:38.005308] WARN [RS] after_restart (ob_root_service.cpp:2717) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:38.005316] WARN [RS] after_restart (ob_root_service.cpp:2724) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=588186928) [2024-01-03 18:06:38.005350] INFO [RS] ob_root_service.cpp:2540 [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:38.005366] WARN [RS] process (ob_root_service.cpp:6243) [1854][168][YB42C0A86EF0-00060E079B24DFC5] [lt=14] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:38.005396] INFO [RS] ob_update_rs_list_task.cpp:104 [1854][168][Y0-00060E079B24DFC6] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:38.005518] INFO [RS] ob_update_rs_list_task.cpp:164 [1854][168][Y0-00060E079B24DFC6] [lt=15] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:38.144615] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C52] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.145458] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C53] [lt=16] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=25, ddl_arg=NULL) [2024-01-03 18:06:38.146272] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2010][468][YB42C0A86EF2-00060E079EC94C54] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.146906] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C55] [lt=74] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:38.147504] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C56] [lt=42] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.148064] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C57] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:38.148616] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C58] [lt=50] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:38.162517] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:38.162555] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:38.162571] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F994479] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:38.162587] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F994479] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=106, ddl_arg=NULL) [2024-01-03 18:06:38.477096] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=8] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:38.477132] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=30] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:38.477142] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:38.536313] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=53] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:38.536366] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276398162485, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-767, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:38.536379] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:38.536462] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=8] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:38.536535] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276397463821, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-973, last_round_trip_time:877, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:38.536563] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:38.579415] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:38.579455] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:38.579473] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=14] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:38.579499] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8E] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=118, ddl_arg=NULL) [2024-01-03 18:06:38.584691] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFC7] [lt=9] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.614341] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFC7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.614378] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFC7] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.614388] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFC7] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.614411] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFC7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.614516] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFC7] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.614530] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFC7] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:38.616424] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.643430] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFEB] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.643466] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFEB] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.643474] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.643499] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.643583] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFEB] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.643597] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFEB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:38.646178] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAA] [lt=6] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:38.681931] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAA] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:38.681976] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAA] [lt=41] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:38.681991] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAA] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:38.682023] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAA] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:38.682137] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAA] [lt=28] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:38.682151] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.333700] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF1-00060E079C428450] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=13, ddl_arg=NULL) [2024-01-03 18:06:39.465012] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=31] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:39.465059] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:39.465071] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:39.465088] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EA] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=111, ddl_arg=NULL) [2024-01-03 18:06:39.468079] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2008][464][YB42C0A86EF1-00060E079C528D37] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.468841] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D38] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:39.469637] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D39] [lt=45] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.470245] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D3A] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:39.470819] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.471310] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D3C] [lt=21] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:39.471797] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3D] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.479912] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=19] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:39.479942] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=25] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:39.479983] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=36] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:39.539138] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=17] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:39.539218] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276398162485, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-767, last_round_trip_time:866, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:39.539239] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:39.539273] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:39.539315] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=5] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276399464980, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-737, last_round_trip_time:863, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:39.539327] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:39.614698] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAB] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.646817] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAB] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.646857] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAB] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.646868] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAB] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.646892] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.646978] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE1] [lt=33] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.647019] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAB] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.647033] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.676150] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE1] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.676188] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.676198] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE1] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.676221] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE1] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.676324] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE1] [lt=27] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.676338] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.682325] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCA] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:39.684265] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D2] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.684733] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D3] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.685187] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D4] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.685634] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D5] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:39.711928] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCA] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:39.711977] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCA] [lt=46] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:39.711987] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCA] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:39.712016] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCA] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:39.712161] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCA] [lt=34] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:39.712178] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCA] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:39.975093] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF0-00060E079A24DAFC] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:40.149561] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.150183] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5A] [lt=26] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:40.150775] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5B] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.151346] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5C] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:40.151845] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5D] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.152375] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C5E] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:40.152901] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C5F] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:40.163488] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:40.163525] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:40.163536] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:40.163552] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447A] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=98, ddl_arg=NULL) [2024-01-03 18:06:40.482565] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:40.482595] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1851][162][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:40.482604] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:40.541582] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:40.541652] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276400163458, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-764, last_round_trip_time:850, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:40.541697] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=38] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:40.541990] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=72] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:40.542034] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276399464980, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-737, last_round_trip_time:863, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:40.542076] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=35] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:40.580526] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:40.580566] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=37] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:40.580578] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:40.580594] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB8F] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=100, ddl_arg=NULL) [2024-01-03 18:06:40.647200] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.679220] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCB] [lt=19] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.679259] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCB] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.679269] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCB] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.679293] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.679358] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF0] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.679428] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCB] [lt=45] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.679442] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCB] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:40.699095] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D6] [lt=28] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=11, ddl_arg=NULL) [2024-01-03 18:06:40.714634] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF0] [lt=33] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.714676] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF0] [lt=39] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.714690] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF0] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.714724] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF0] [lt=11] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.714805] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:40.714855] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF0] [lt=15] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.714878] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF0] [lt=15] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:40.744737] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAE] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:40.744801] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAE] [lt=61] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:40.744814] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAE] [lt=11] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:40.744838] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:40.744939] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAE] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:40.744972] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAE] [lt=26] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.466187] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:41.466235] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:41.466247] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:41.466263] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EB] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=109, ddl_arg=NULL) [2024-01-03 18:06:41.472650] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D3F] [lt=16] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.473293] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D40] [lt=13] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:41.473921] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D41] [lt=35] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.474572] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D42] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:41.475296] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D43] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.476025] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D44] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=24, ddl_arg=NULL) [2024-01-03 18:06:41.476610] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D45] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.484905] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:41.484934] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:41.484943] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:41.544157] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:41.544213] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276400163458, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-764, last_round_trip_time:850, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:41.544238] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=21] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:41.544842] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=27] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:41.544923] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=12] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276401466157, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:879, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:41.544936] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:41.544988] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=12] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:41.545005] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=9] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:41.545107] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=62] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:41.545862] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=29] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:41.546074] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=8] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:41.547088] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=10] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:41.547097] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:41.547281] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=24] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:41.548120] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=21] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:41.548127] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:41.548311] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=20] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:41.548333] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=20] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:41.548341] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:41.548421] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:41.548442] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=19] [dc=0] broadcast root address succeed [2024-01-03 18:06:41.549766] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:41.549813] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=30] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:41.549823] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:41.552233] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:41.553755] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=37] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:41.679594] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFAF] [lt=56] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.710255] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFAF] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.710289] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFAF] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.710300] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFAF] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.710333] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFAF] [lt=8] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.710464] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFAF] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.710477] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFAF] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.715036] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE6] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.743127] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE6] [lt=6] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.743168] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE6] [lt=38] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.743180] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE6] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.743204] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE6] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.743289] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE6] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.743302] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.745183] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFCE] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:41.776505] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFCE] [lt=27] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:41.776540] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFCE] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:41.776552] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFCE] [lt=10] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:41.776574] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFCE] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:41.776664] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFCE] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:41.776680] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFCE] [lt=10] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:41.812919] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:41.812933] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=10] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:41.826565] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=28] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.826624] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=38] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.826639] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=7] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:41.827531] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D7] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828053] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D8] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828421] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0D9] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:41.828788] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DA] [lt=23] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.035094] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=27] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:42.035105] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:42.035117] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=143) [2024-01-03 18:06:42.035126] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:42.035134] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:42.035142] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=6] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=592216755) [2024-01-03 18:06:42.035168] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=7] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:42.035188] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFF4] [lt=18] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:42.035226] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFF5] [lt=11] [dc=0] start to process rs list update task [2024-01-03 18:06:42.035365] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFF5] [lt=22] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:42.153835] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C61] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.154542] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C62] [lt=11] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=23, ddl_arg=NULL) [2024-01-03 18:06:42.155188] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C63] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.155679] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C64] [lt=47] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:42.156160] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2018][484][YB42C0A86EF2-00060E079EC94C65] [lt=36] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.156764] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C66] [lt=32] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:42.157319] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C67] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:42.164455] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:42.164492] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:42.164507] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=13] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:42.164523] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447B] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=103, ddl_arg=NULL) [2024-01-03 18:06:42.487570] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=21] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:42.487599] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:42.487609] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:42.547348] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=30] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:42.547400] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276402164425, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:42.547413] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:42.547760] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=18] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:42.547802] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276401466157, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-945, last_round_trip_time:879, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:42.547814] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:42.581530] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:42.581576] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=41] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:42.581594] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=15] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:42.581618] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB90] [lt=12] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=120, ddl_arg=NULL) [2024-01-03 18:06:42.710618] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF6] [lt=20] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.740878] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF6] [lt=13] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.740912] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF6] [lt=32] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.740922] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF6] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.740964] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF6] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.741057] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF6] [lt=14] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.741071] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF6] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:42.743457] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFB2] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.772768] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFB2] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.772803] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFB2] [lt=33] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.772813] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFB2] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.772836] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFB2] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.772919] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFB2] [lt=10] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.772932] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFB2] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:42.776792] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFE9] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:42.807968] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFE9] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:42.808013] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFE9] [lt=42] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:42.808028] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFE9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:42.808060] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFE9] [lt=9] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:42.808238] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFE9] [lt=66] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:42.808260] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFE9] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.467314] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=11] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:43.467352] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:43.467363] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:43.467379] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EC] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=97, ddl_arg=NULL) [2024-01-03 18:06:43.477555] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D46] [lt=60] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.478216] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D47] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:43.478910] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D48] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.479459] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D49] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:43.479974] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4A] [lt=31] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.480473] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D4B] [lt=29] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:43.481071] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4C] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.490123] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=31] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:43.490153] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:43.490162] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:43.549965] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=49] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:43.550016] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276402164425, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-754, last_round_trip_time:810, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:43.550034] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:43.550198] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=28] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:43.550241] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276403467285, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-917, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:43.550267] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=22] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:43.741221] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFEA] [lt=12] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.775004] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFEA] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.775038] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFEA] [lt=31] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.775047] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFEA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.775070] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFEA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.775127] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFD3] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.775167] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFEA] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.775179] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFEA] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.804337] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFD3] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.804373] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFD3] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.804383] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFD3] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.804407] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFD3] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.804502] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFD3] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.804515] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFD3] [lt=6] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:43.808436] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFF9] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:43.829893] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DB] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.830533] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DC] [lt=18] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.831073] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DD] [lt=44] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.831507] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0DE] [lt=24] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:43.838322] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFF9] [lt=35] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:43.838371] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFF9] [lt=45] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:43.838385] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFF9] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:43.838408] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFF9] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:43.838528] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFF9] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:43.838541] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFF9] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.158304] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C68] [lt=26] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.159041] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C69] [lt=25] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=15, ddl_arg=NULL) [2024-01-03 18:06:44.159694] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C6A] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.160326] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C6B] [lt=33] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:44.160868] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C6C] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.161416] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C6D] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:44.161884] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2012][472][YB42C0A86EF2-00060E079EC94C6E] [lt=40] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:44.165393] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:44.165431] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:44.165442] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:44.165459] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447C] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=101, ddl_arg=NULL) [2024-01-03 18:06:44.334628] INFO [RS] ob_rs_rpc_processor.h:196 [2022][492][YB42C0A86EF1-00060E079C428451] [lt=41] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=9, ddl_arg=NULL) [2024-01-03 18:06:44.492608] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1853][166][Y0-0000000000000000] [lt=92] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:44.492655] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1853][166][Y0-0000000000000000] [lt=41] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:44.492664] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:44.552442] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:44.552474] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:44.552493] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276404165362, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:44.552508] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:44.552517] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276403467285, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-917, last_round_trip_time:882, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:44.552530] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=10] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:44.582425] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=6] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:44.582488] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:44.582501] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:44.582518] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB91] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=127, ddl_arg=NULL) [2024-01-03 18:06:44.775328] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44DFFA] [lt=13] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.805366] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44DFFA] [lt=16] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.805403] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44DFFA] [lt=34] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.805412] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44DFFA] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.805437] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44DFFA] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.805509] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.805557] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44DFFA] [lt=26] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.805571] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44DFFA] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.835624] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.835679] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFB7] [lt=51] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.835693] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFB7] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.835717] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFB7] [lt=6] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.835818] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFB7] [lt=22] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.835833] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFB7] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.838692] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:44.868526] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFED] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:44.868544] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFED] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:44.868552] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:44.868577] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFED] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:44.868694] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFED] [lt=30] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:44.868717] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFED] [lt=13] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:44.975699] INFO [RS] ob_rs_rpc_processor.h:196 [2015][478][YB42C0A86EF0-00060E079A24DAFD] [lt=86] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:45.468367] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:45.468405] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=34] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:45.468416] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:45.468434] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284ED] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=131, ddl_arg=NULL) [2024-01-03 18:06:45.495026] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=53] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:45.495045] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=15] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:45.495055] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:45.554981] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=10] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:45.555033] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276405468306, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:884, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:45.555038] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:45.555045] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:45.555081] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=7] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276404165362, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-736, last_round_trip_time:813, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:45.555099] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=14] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:45.555119] INFO [RS] ob_root_service.cpp:2707 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: start to do restart task [2024-01-03 18:06:45.555134] INFO [RS] ob_root_service.cpp:5490 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: start do_restart [2024-01-03 18:06:45.555199] INFO [RS] ob_root_service.cpp:6142 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=8] [dc=0] got __all_core_table member list(member_list=["192.168.110.240:2882", "192.168.110.241:2882", "192.168.110.242:2882"]) [2024-01-03 18:06:45.555986] INFO [RS] ob_root_service.cpp:2484 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=44] [dc=0] added async task to update rslist(force_update=false) [2024-01-03 18:06:45.556191] INFO [RS] ob_root_service.cpp:6148 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=16] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone1", server:"192.168.110.240:2882", sql_port:2881, unit_id:18446744073709551615, role:1, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:1704275809750552, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809608801}, server="192.168.110.240:2882") [2024-01-03 18:06:45.557132] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=14] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:45.557146] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:45.557351] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone2", server:"192.168.110.241:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809645461}, server="192.168.110.241:2882") [2024-01-03 18:06:45.558178] INFO [RS] ob_update_rs_list_task.cpp:56 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=8] [dc=0] update rslist task exist, do not submit again(cnt=2) [2024-01-03 18:06:45.558184] WARN [RS] submit_update_rslist_task (ob_root_service.cpp:2490) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] fail to submit update rslist task, need retry(force_update=false) [2024-01-03 18:06:45.558360] INFO [RS] ob_root_service.cpp:6169 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=15] [dc=0] update __all_core_table replica succeed(replica={table_id:{value:1099511627777, first:1, second:1}, partition_id:0, partition_cnt:1, zone:"zone3", server:"192.168.110.242:2882", sql_port:2881, unit_id:18446744073709551615, role:2, member_list:[{server:"192.168.110.240:2882", timestamp:1704275809606211}, {server:"192.168.110.241:2882", timestamp:1704275809606216}, {server:"192.168.110.242:2882", timestamp:1704275809606217}], row_count:0, data_size:0, data_version:1, data_checksum:0, row_checksum:row:[0], modify_time_us:0, create_time_us:0, member_time_us:0, is_original_leader:false, in_member_list:false, rebuild:false, to_leader_time:0, replica_status:"REPLICA_STATUS_NORMAL", replica_type:0, required_size:0, status:"REPLICA_STATUS_NORMAL", is_restore:0, partition_checksum:0, quorum:3, recovery_timestamp:0, fail_list:"", property:{memstore_percent_:100}, data_file_id:1704275809682748}, server="192.168.110.242:2882") [2024-01-03 18:06:45.558372] INFO [RS] ob_root_service.cpp:5514 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=10] [dc=0] START_SERVICE: fetch root partition info succeed(ret=0) [2024-01-03 18:06:45.558380] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] start to process rs list update task [2024-01-03 18:06:45.558463] INFO [RS] ob_update_rs_list_task.cpp:141 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=22] [dc=0] store rs list succeed(new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], cluster_type=1) [2024-01-03 18:06:45.558471] INFO [RS] ob_root_service.cpp:2581 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] broadcast root address succeed [2024-01-03 18:06:45.560114] INFO [RS] ob_freeze_info_manager.cpp:113 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] set current frozen status success(frozen_version=1, frozen_timestamp=1, cluster_version=12884967425, tenant_schemas=[]) [2024-01-03 18:06:45.560169] INFO [RS] ob_freeze_info_manager.cpp:303 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=37] [dc=0] set new freeze info(freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:45.560180] INFO [RS] ob_root_service.cpp:5533 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=9] [dc=0] START_SERVICE: freeze info manager reload success [2024-01-03 18:06:45.562564] INFO [RS] ob_root_service.cpp:5550 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=7] [dc=0] START_SERVICE: load split schema version success [2024-01-03 18:06:45.564187] INFO [RS] ob_root_service.cpp:5565 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=40] [dc=0] START_SERVICE: load schema status success [2024-01-03 18:06:45.622350] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D4E] [lt=56] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.623091] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D4F] [lt=22] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=16, ddl_arg=NULL) [2024-01-03 18:06:45.623779] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D50] [lt=37] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.624317] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D51] [lt=77] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=6, ddl_arg=NULL) [2024-01-03 18:06:45.624801] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D52] [lt=13] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.625277] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D53] [lt=27] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=5, ddl_arg=NULL) [2024-01-03 18:06:45.625749] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D54] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.699887] INFO [RS] ob_rs_rpc_processor.h:196 [2005][458][YB42C0A86EF2-00060E079EA943D7] [lt=65] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=14, ddl_arg=NULL) [2024-01-03 18:06:45.804508] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=true) [2024-01-03 18:06:45.804533] WARN [RS] do_restart (ob_root_service.cpp:5579) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=20] [dc=0] START_SERVICE: refresh schema failed(tmp_ret=-4016, load_frozen_status=true) [2024-01-03 18:06:45.805737] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFEE] [lt=11] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.832480] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2022][492][YB42C0A86EF0-00060E079A34E0DF] [lt=63] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.833107] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E0] [lt=38] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.833610] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E1] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.834221] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E2] [lt=67] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:45.837143] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFEE] [lt=7] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.837182] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFEE] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.837192] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFEE] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.837216] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFEE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.837319] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFD8] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.837340] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFEE] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.837355] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFEE] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:45.873158] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFD8] [lt=46] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.873198] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFD8] [lt=37] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.873208] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFD8] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.873241] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFD8] [lt=15] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.873318] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBA] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:45.873444] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFD8] [lt=98] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.873460] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFD8] [lt=9] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:45.903844] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBA] [lt=98] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:45.903878] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBA] [lt=30] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:45.903895] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBA] [lt=14] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:45.903930] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBA] [lt=10] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:45.904067] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBA] [lt=25] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:45.904082] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBA] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.011742] WARN [RS] refresh_schema (ob_root_service.cpp:9005) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:46.011756] WARN [RS] do_restart (ob_root_service.cpp:5586) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=10] [dc=0] START_SERVICE: refresh schema failed(ret=-4016, load_frozen_status=false) [2024-01-03 18:06:46.011768] WARN [RS] update_fail_count (ob_root_service.cpp:11447) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] rs_monitor_check : fail to start root service(ret=-4016, ret="OB_ERR_UNEXPECTED", count=144) [2024-01-03 18:06:46.011781] INFO [RS] ob_root_service.cpp:5901 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=12] [dc=0] START_SERVICE: finish do_restart(ret=-4016) [2024-01-03 18:06:46.011790] WARN [RS] after_restart (ob_root_service.cpp:2717) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] START_SERVICE: do restart failed, retry again(ret=-4016) [2024-01-03 18:06:46.011798] WARN [RS] after_restart (ob_root_service.cpp:2724) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=5] [dc=0] START_SERVICE: do restart task failed, retry again(ret=-4016, cost=596193410) [2024-01-03 18:06:46.011827] INFO [RS] ob_root_service.cpp:2540 [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] submit restart task success(delay=3000000) [2024-01-03 18:06:46.011835] WARN [RS] process (ob_root_service.cpp:6243) [1851][162][YB42C0A86EF0-00060E079B44DFFE] [lt=6] [dc=0] START_SERVICE: root service after restart failed(ret=-4016) [2024-01-03 18:06:46.011866] INFO [RS] ob_update_rs_list_task.cpp:104 [1851][162][Y0-00060E079B44DFFF] [lt=7] [dc=0] start to process rs list update task [2024-01-03 18:06:46.012055] INFO [RS] ob_update_rs_list_task.cpp:164 [1851][162][Y0-00060E079B44DFFF] [lt=35] [dc=0] store rs list succeed(ret=0, new_rs_list=[{server:"192.168.110.240:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.241:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}, {server:"192.168.110.242:2882", role:2, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], new_readonly_rs_list=[], inner_need_update=true, cluster_type=1) [2024-01-03 18:06:46.166460] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:46.166508] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=44] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:46.166521] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=10] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:46.166538] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447D] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=155, ddl_arg=NULL) [2024-01-03 18:06:46.300458] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C70] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.301212] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C71] [lt=24] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=18, ddl_arg=NULL) [2024-01-03 18:06:46.301922] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C72] [lt=32] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.302513] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C73] [lt=37] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=7, ddl_arg=NULL) [2024-01-03 18:06:46.303033] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C74] [lt=71] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.303548] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF2-00060E079EC94C75] [lt=34] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:46.304076] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF2-00060E079EC94C76] [lt=27] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:46.497499] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1852][164][Y0-0000000000000000] [lt=20] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:46.497528] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1852][164][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:46.497538] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=7] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:46.557427] WARN [RS] update (ob_server_table_operator.cpp:190) [1853][166][Y0-0000000000000000] [lt=16] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:46.557441] WARN [RS] update (ob_server_table_operator.cpp:190) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:46.557478] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1853][166][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276406166388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:46.557483] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1854][168][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276405468306, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-959, last_round_trip_time:884, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:46.557491] WARN [RS] process (ob_all_server_task.cpp:54) [1853][166][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:46.557495] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=9] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:46.583303] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=10] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:46.583343] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=36] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:46.583354] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:46.583395] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF0-00060E079BC4DB92] [lt=8] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=126, ddl_arg=NULL) [2024-01-03 18:06:46.828050] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=11] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.828116] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=39] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.828134] INFO [RS] ob_server_table_operator.cpp:378 [1770][2][Y0-0000000000000000] [lt=8] [dc=0] svr_status(svr_status="active", display_status=1) [2024-01-03 18:06:46.837499] INFO [RS] ob_system_admin_util.cpp:2395 [1851][162][Y0-00060E079B44E000] [lt=28] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.866940] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1851][162][Y0-00060E079B44E000] [lt=10] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.866994] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1851][162][Y0-00060E079B44E000] [lt=52] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.867004] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1851][162][Y0-00060E079B44E000] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.867028] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1851][162][Y0-00060E079B44E000] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.867132] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1851][162][Y0-00060E079B44E000] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.867148] WARN [RS] process (ob_root_service.cpp:9480) [1851][162][Y0-00060E079B44E000] [lt=8] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.873618] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.903387] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFF1] [lt=12] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.903425] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFF1] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.903439] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFF1] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.903464] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.903565] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFF1] [lt=23] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.903580] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFF1] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:46.904256] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:46.938868] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBD] [lt=15] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:46.938907] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBD] [lt=36] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:46.938918] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBD] [lt=9] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:46.938942] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:46.939059] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBD] [lt=12] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:46.939075] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.469533] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=8] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:47.469572] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=35] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:47.469584] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=9] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:47.469600] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF1-00060E079D4284EE] [lt=7] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=102, ddl_arg=NULL) [2024-01-03 18:06:47.500394] WARN [RS] reset_rootserver (ob_server_table_operator.cpp:231) [1854][168][Y0-0000000000000000] [lt=22] [dc=0] execute sql failed(sql=UPDATE __all_server SET WITH_ROOTSERVER=0 WHERE WITH_ROOTSERVER=1 AND (SVR_IP, SVR_PORT) != ('192.168.110.240', 2882), ret=-5627) [2024-01-03 18:06:47.500423] WARN [RS] adjust_server_status (ob_server_manager.cpp:1935) [1854][168][Y0-0000000000000000] [lt=24] [dc=0] reset rootserver in all server table failed(ret=-5627, server="192.168.110.240:2882") [2024-01-03 18:06:47.500433] WARN [RS] process (ob_all_server_task.cpp:54) [1854][168][Y0-0000000000000000] [lt=8] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.240:2882") [2024-01-03 18:06:47.560359] WARN [RS] update (ob_server_table_operator.cpp:190) [1852][164][Y0-0000000000000000] [lt=26] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:47.560460] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1852][164][Y0-0000000000000000] [lt=9] [dc=0] update server in all server table failed(ret=-5627, server_status=id:2, zone:"zone2", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.241:2882", sql_port:2881, register_time:1704275813129316, last_hb_time:1704276407469502, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-894, last_round_trip_time:875, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:47.560475] WARN [RS] process (ob_all_server_task.cpp:54) [1852][164][Y0-0000000000000000] [lt=12] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.241:2882") [2024-01-03 18:06:47.560591] WARN [RS] update (ob_server_table_operator.cpp:190) [1851][162][Y0-0000000000000000] [lt=36] [dc=0] exec update failed(ret=-5627) [2024-01-03 18:06:47.560648] WARN [RS] adjust_server_status (ob_server_manager.cpp:1940) [1851][162][Y0-0000000000000000] [lt=6] [dc=0] update server in all server table failed(ret=-5627, server_status=id:3, zone:"zone3", build_version:"3.1.1_4-8c615943cbd25a6f7b8bdfd8677a13a21709a05e(Oct 21 2021 10:33:14)", server:"192.168.110.242:2882", sql_port:2881, register_time:1704275811830238, last_hb_time:1704276406166388, block_migrate_in_time:0, stop_time:0, start_service_time:0, last_offline_time:0, last_server_behind_time:-745, last_round_trip_time:798, admin_status:"NORMAL", hb_status:"alive", with_rootserver:false, with_partition:true, resource_info:{cpu:"1.400000000000000000e+01", mem_in_use:0, mem_total:5368709120, disk_in_use:4194304, disk_total:32212254720, partition_cnt:1198, report_cpu_assigned:"2.500000000000000000e+00", report_cpu_max_assigned:"5.000000000000000000e+00", report_mem_assigned:1342177280, report_mem_max_assigned:1610612736}, leader_cnt:-1, server_report_status:0, lease_expire_time:1704275850769222, ssl_key_expired_time:0, in_recovery_for_takenover_by_rs:false) [2024-01-03 18:06:47.560665] WARN [RS] process (ob_all_server_task.cpp:54) [1851][162][Y0-0000000000000000] [lt=13] [dc=0] fail to adjust server status(ret=-5627, server_="192.168.110.242:2882") [2024-01-03 18:06:47.626864] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D55] [lt=29] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.627876] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D56] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=31, ddl_arg=NULL) [2024-01-03 18:06:47.628539] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D57] [lt=68] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.629229] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D58] [lt=35] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=10, ddl_arg=NULL) [2024-01-03 18:06:47.629758] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D59] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.630469] INFO [RS] ob_rs_rpc_processor.h:196 [2098][644][YB42C0A86EF1-00060E079C528D5A] [lt=31] [dc=0] [DDL] execute ddl like stmt(ret=0, cost=8, ddl_arg=NULL) [2024-01-03 18:06:47.631227] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF1-00060E079C528D5B] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.835079] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E4] [lt=33] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.835621] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E5] [lt=34] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.836049] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E6] [lt=28] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.836602] WARN [RS] process_ (ob_rs_rpc_processor.h:110) [2005][458][YB42C0A86EF0-00060E079A34E0E7] [lt=25] [dc=0] RS is initializing, can not process this request(ret=-8001, full_service_=true, root_service_.is_full_service()=false, pcode=281) [2024-01-03 18:06:47.867288] INFO [RS] ob_system_admin_util.cpp:2395 [1853][166][Y0-00060E079B14DFBE] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.897349] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1853][166][Y0-00060E079B14DFBE] [lt=28] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.897367] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1853][166][Y0-00060E079B14DFBE] [lt=16] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.897381] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1853][166][Y0-00060E079B14DFBE] [lt=12] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.897406] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1853][166][Y0-00060E079B14DFBE] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.897498] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1853][166][Y0-00060E079B14DFBE] [lt=11] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.897513] WARN [RS] process (ob_root_service.cpp:9480) [1853][166][Y0-00060E079B14DFBE] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.903721] INFO [RS] ob_system_admin_util.cpp:2395 [1854][168][Y0-00060E079B24DFDD] [lt=8] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.932142] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1854][168][Y0-00060E079B24DFDD] [lt=9] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.932180] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1854][168][Y0-00060E079B24DFDD] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.932194] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1854][168][Y0-00060E079B24DFDD] [lt=13] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.932218] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1854][168][Y0-00060E079B24DFDD] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.932343] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1854][168][Y0-00060E079B24DFDD] [lt=48] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.932356] WARN [RS] process (ob_root_service.cpp:9480) [1854][168][Y0-00060E079B24DFDD] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:47.939221] INFO [RS] ob_system_admin_util.cpp:2395 [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] execute set config request(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}) [2024-01-03 18:06:47.969457] WARN [RS] check_inner_stat (ob_zone_manager.cpp:83) [1852][164][Y0-00060E079B34DFF4] [lt=8] [dc=0] inner_stat_error(inited=true, loaded=false, ret=-4014) [2024-01-03 18:06:47.969495] WARN [RS] get_config_version (ob_zone_manager.cpp:1390) [1852][164][Y0-00060E079B34DFF4] [lt=35] [dc=0] check_inner_stat failed(ret=-4014) [2024-01-03 18:06:47.969505] WARN [RS] execute (ob_system_admin_util.cpp:2407) [1852][164][Y0-00060E079B34DFF4] [lt=8] [dc=0] get_config_version failed(ret=-4014) [2024-01-03 18:06:47.969530] WARN [RS] admin_set_config (ob_root_service.cpp:8178) [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] execute set config failed(arg={items:[{name:"all_server_list", value:"192.168.110.240:2882,192.168.110.241:2882,192.168.110.242:2882", comment:"", zone:"", server:"0.0.0.0", tenant_name:"", exec_tenant_id:1, tenant_ids:[]}], is_inner:true}, ret=-4014) [2024-01-03 18:06:47.969636] WARN [RS] update_all_server_config (ob_root_service.cpp:9307) [1852][164][Y0-00060E079B34DFF4] [lt=24] [dc=0] fail to set config(ret=-4014) [2024-01-03 18:06:47.969650] WARN [RS] process (ob_root_service.cpp:9480) [1852][164][Y0-00060E079B34DFF4] [lt=7] [dc=0] fail to update all server config(ret=-4014) [2024-01-03 18:06:48.167508] WARN [RS] get_freeze_info_shadow (ob_freeze_info_manager.cpp:330) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=7] [dc=0] inner stat error(ret=-4014, ret="OB_INNER_STAT_ERROR", freeze_info={is_loaded:false, fast_loaded:true, current_frozen_status:{frozen_version:1, frozen_timestamp:1, cluster_version:12884967425}, frozen_schema_versions:[], frozen_status_without_schema_version:[], latest_snapshot_gc_ts:0, latest_snapshot_gc_schema_versions:[], latest_defined_frozen_version:0, latest_multi_versions:[]}) [2024-01-03 18:06:48.167550] WARN [RS] get_freeze_info (ob_freeze_info_manager.cpp:459) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=38] [dc=0] fail to get freeze info shadow(ret=-4014, ret="OB_INNER_STAT_ERROR") [2024-01-03 18:06:48.167565] WARN [RS] renew_lease (ob_root_service.cpp:3153) [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=12] [dc=0] fail to get frozen status, rs may not complete restart(temp_ret=-4014) [2024-01-03 18:06:48.167594] INFO [RS] ob_rs_rpc_processor.h:196 [1820][100][YB42C0A86EF2-00060E079F99447E] [lt=15] [dc=0] [DDL] ex