[2024-05-04 05:23:47.688220] ERROR easy_connection_update_ack_bytes_and_time (easy_connection.c:2154) [37290][RpcIO][T0][Y0-0000000000000000-0-0] [lt=14] Failed to do TIOCOUTQ ioctl on connection(0.0.0.0_127.0.0.1:56260_90_0x14fee5f3ea20 tp=0 t=1713920575687891-1714771427471849 s=0 r=0 io=1108572571/402702542 sq=402702122), errno(88), strerror(Socket operation on non-socket). BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf803ba 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:47.659274] ERROR easy_connection_update_ack_bytes_and_time (easy_connection.c:2154) [37293][RpcIO][T0][Y0-0000000000000000-0-0] [lt=91] Failed to do TIOCOUTQ ioctl on connection(0.0.0.0_127.0.0.1:56272_98_0x14fee5d27d80 tp=0 t=1713920580658516-1714771427467848 s=0 r=0 io=1108432615/402674839 sq=402674419), errno(9), strerror(Bad file descriptor). BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf803ba 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:47.651507] ERROR easy_connection_update_ack_bytes_and_time (easy_connection.c:2154) [37292][RpcIO][T0][Y0-0000000000000000-0-0] [lt=135] Failed to do TIOCOUTQ ioctl on connection(0.0.0.0_127.0.0.1:56270_96_0x14fee5ff9d00 tp=0 t=1713920580650820-1714771427217764 s=0 r=0 io=1108434347/402690535 sq=402690115), errno(9), strerror(Bad file descriptor). BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf803ba 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:47.745287] ERROR [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:510) [37289][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=47] add to epoll failed, addr: 127.0.0.1:3310, err: 22 BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0x3bee6d1 0xb843cee 0xb8412de 0xb5f880c 0xb5f6f5a 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:49.170492] ERROR [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:510) [37289][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=674799] add to epoll failed, addr: 127.0.0.1:3310, err: 9 BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0x3bee6d1 0xb843cee 0xb8412de 0xb5f880c 0xb5f6f5a 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:49.216915] ERROR net_send_negotiate_message (easy_negotiation.c:224) [37292][RpcIO][T0][Y0-0000000000000000-0-0] [lt=10] send negotiate msg failed. addr: 0.0.0.0,errno:Broken pipe BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf8d948 0xcf8de6a 0xcf7e0d3 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:49.924101] ERROR [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:510) [37289][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=67] add to epoll failed, addr: 127.0.0.1:3310, err: 9 BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0x3bee6d1 0xb843cee 0xb8412de 0xb5f880c 0xb5f6f5a 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:49.966600] ERROR net_send_negotiate_message (easy_negotiation.c:224) [37291][RpcIO][T0][Y0-0000000000000000-0-0] [lt=11] send negotiate msg failed. addr: 0.0.0.0,errno:Broken pipe BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf8d948 0xcf8de6a 0xcf7e0d3 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:50.674544] ERROR [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:510) [37289][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=58] add to epoll failed, addr: 127.0.0.1:3310, err: 9 BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0x3bee6d1 0xb843cee 0xb8412de 0xb5f880c 0xb5f6f5a 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:50.717067] ERROR easy_connection_do_connect (easy_connection.c:2873) [37292][RpcIO][T0][Y0-0000000000000000-0-0] [lt=141] Failed to do connect, conn(0.0.0.0:33244_127.0.0.1:3310_89_0x14fe4f004290 tp=1 t=0-0 s=0 r=0 io=0/0 sq=0), errno(111), strerror(Connection refused). BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf7beaa 0x3a27938 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:50.717308] ERROR easy_connection_do_client (easy_connection.c:3045) [37292][RpcIO][T0][Y0-0000000000000000-0-0] [lt=200] Failed to do connect, conn(null). BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf7c075 0x3a27938 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:51.424952] ERROR [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:510) [37289][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=56] add to epoll failed, addr: 127.0.0.1:3310, err: 9 BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0x3bee6d1 0xb843cee 0xb8412de 0xb5f880c 0xb5f6f5a 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:51.466766] ERROR net_send_negotiate_message (easy_negotiation.c:224) [37291][RpcIO][T0][Y0-0000000000000000-0-0] [lt=210] send negotiate msg failed. addr: 0.0.0.0,errno:Broken pipe BACKTRACE:0xb617e7b 0xb609956 0x3beec0a 0x3bee8e7 0xb884ce4 0xcf8d948 0xcf8de6a 0xcf7e0d3 0x3a22398 0xcf776f5 0x3a40418 0xcf81cac 0x14ff2025cfed 0x14ff2018e18f [2024-05-04 05:23:51.625394] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57B5-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4121, ret="OB_RPC_SEND_ERROR") [2024-05-04 05:23:51.625486] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57B5-0-0] [lt=91] update replica failed(ret=-4121, ret="OB_RPC_SEND_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.625516] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57B5-0-0] [lt=28] fail to update replica(ret=-4121, ret="OB_RPC_SEND_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.678644] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BA-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.678708] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BA-0-0] [lt=64] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.678736] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BA-0-0] [lt=26] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.689122] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BB-0-0] [lt=25] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.689179] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BB-0-0] [lt=56] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.689200] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BB-0-0] [lt=21] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.699515] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BC-0-0] [lt=27] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.699588] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BC-0-0] [lt=73] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.699610] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BC-0-0] [lt=20] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.709877] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BD-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.709924] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BD-0-0] [lt=46] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.709945] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BD-0-0] [lt=20] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.725102] WARN [STORAGE.TRANS] post_cluster_heartbeat_rpc_ (ob_tenant_weak_read_service.cpp:800) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=13] post cluster heartbeat fail(ret=-4122, ret="OB_RPC_POST_ERROR", cluster_service_master="127.0.0.1:3310", tenant_id_=1, req={req_server:"127.0.0.1:3310", version:1714771431426246090, valid_part_count:1, total_part_count:1, generate_timestamp:1714771431724949}, cluster_service_tablet_id={id:226}) [2024-05-04 05:23:51.725174] WARN [STORAGE.TRANS] do_cluster_heartbeat_ (ob_tenant_weak_read_service.cpp:756) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] post cluster heartbeat rpc fail(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id_=1, local_server_version=1714771431426246090, valid_part_count=1, total_part_count=1, generate_timestamp=1714771431724949) [2024-05-04 05:23:51.725195] WARN [STORAGE.TRANS] do_cluster_heartbeat_ (ob_tenant_weak_read_service.cpp:766) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] tenant weak read service do cluster heartbeat fail(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id_=1, last_post_cluster_heartbeat_tstamp_=1714771431624903, cluster_heartbeat_interval_=50000, cluster_service_tablet_id={id:226}, cluster_service_master="127.0.0.1:3310") [2024-05-04 05:23:51.730634] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BF-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.730678] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BF-0-0] [lt=43] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.730701] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57BF-0-0] [lt=21] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.751073] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C1-0-0] [lt=8] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.751125] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C1-0-0] [lt=51] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.751152] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C1-0-0] [lt=26] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.771501] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C3-0-0] [lt=8] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.771538] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C3-0-0] [lt=37] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.771559] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C3-0-0] [lt=20] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.781687] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C4-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.781723] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C4-0-0] [lt=36] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.781751] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C4-0-0] [lt=26] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.791962] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C5-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.792032] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C5-0-0] [lt=70] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.802321] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C6-0-0] [lt=8] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.802360] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C6-0-0] [lt=38] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.802393] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C6-0-0] [lt=31] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.804676] WARN [RPC] call_rpc (ob_async_rpc_proxy.h:306) [37258][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=10] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}, cluster_id=1, tenant_id=1, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.804701] WARN [RPC] call (ob_async_rpc_proxy.h:263) [37258][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=24] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, cluster_id=1, tenant_id=1, arg={addr:"127.0.0.1:3310", cluster_id:1}, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.813571] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C7-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.813632] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C7-0-0] [lt=61] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.813663] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C7-0-0] [lt=28] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.823935] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C8-0-0] [lt=9] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.824000] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C8-0-0] [lt=64] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.824029] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57C8-0-0] [lt=27] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.825883] WARN [RPC] call_rpc (ob_async_rpc_proxy.h:306) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473B-0-0] [lt=11] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}, cluster_id=1, tenant_id=1, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.825905] WARN [RPC] call (ob_async_rpc_proxy.h:263) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473B-0-0] [lt=22] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, cluster_id=1, tenant_id=1, arg={addr:"127.0.0.1:3310", cluster_id:1}, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.825924] WARN [SHARE.PT] do_detect_master_rs_ls_ (ob_rpc_ls_table.cpp:290) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473B-0-0] [lt=16] fail to send rpc(tmp_ret=-4122, tmp_ret="OB_RPC_POST_ERROR", cluster_id=1, addr="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}) [2024-05-04 05:23:51.854860] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CB-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.854915] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CB-0-0] [lt=55] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.865203] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CC-0-0] [lt=10] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.865259] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CC-0-0] [lt=55] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.865301] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CC-0-0] [lt=40] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.875558] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CD-0-0] [lt=10] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.875603] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CD-0-0] [lt=44] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.875635] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CD-0-0] [lt=31] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.885959] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CE-0-0] [lt=10] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.886061] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CE-0-0] [lt=101] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.886089] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CE-0-0] [lt=27] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.896400] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CF-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.896451] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CF-0-0] [lt=51] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.896502] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57CF-0-0] [lt=49] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.917248] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D1-0-0] [lt=13] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.917359] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D1-0-0] [lt=134] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.917399] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D1-0-0] [lt=38] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.925245] WARN [STORAGE.TRANS] post_cluster_heartbeat_rpc_ (ob_tenant_weak_read_service.cpp:800) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=12] post cluster heartbeat fail(ret=-4122, ret="OB_RPC_POST_ERROR", cluster_service_master="127.0.0.1:3310", tenant_id_=1, req={req_server:"127.0.0.1:3310", version:1714771431426246090, valid_part_count:1, total_part_count:1, generate_timestamp:1714771431925145}, cluster_service_tablet_id={id:226}) [2024-05-04 05:23:51.925325] WARN [STORAGE.TRANS] do_cluster_heartbeat_ (ob_tenant_weak_read_service.cpp:756) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] post cluster heartbeat rpc fail(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id_=1, local_server_version=1714771431426246090, valid_part_count=1, total_part_count=1, generate_timestamp=1714771431925145) [2024-05-04 05:23:51.925340] WARN [STORAGE.TRANS] do_cluster_heartbeat_ (ob_tenant_weak_read_service.cpp:766) [37624][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] tenant weak read service do cluster heartbeat fail(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id_=1, last_post_cluster_heartbeat_tstamp_=1714771431725235, cluster_heartbeat_interval_=100000, cluster_service_tablet_id={id:226}, cluster_service_master="127.0.0.1:3310") [2024-05-04 05:23:51.926147] WARN [RPC] call_rpc (ob_async_rpc_proxy.h:306) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473C-0-0] [lt=12] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}, cluster_id=1, tenant_id=1, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.926170] WARN [RPC] call (ob_async_rpc_proxy.h:263) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473C-0-0] [lt=24] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, cluster_id=1, tenant_id=1, arg={addr:"127.0.0.1:3310", cluster_id:1}, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.926189] WARN [SHARE.PT] do_detect_master_rs_ls_ (ob_rpc_ls_table.cpp:290) [37246][SysLocAsyncUp0][T0][YCEE7F000001-000616CD3ACE473C-0-0] [lt=16] fail to send rpc(tmp_ret=-4122, tmp_ret="OB_RPC_POST_ERROR", cluster_id=1, addr="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}) [2024-05-04 05:23:51.948036] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D4-0-0] [lt=62] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.948097] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D4-0-0] [lt=60] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.948123] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D4-0-0] [lt=24] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.958455] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D5-0-0] [lt=10] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.958515] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D5-0-0] [lt=78] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.958590] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D5-0-0] [lt=74] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.968855] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D6-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.968902] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D6-0-0] [lt=46] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.968967] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D6-0-0] [lt=64] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.979297] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D7-0-0] [lt=32] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.979340] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D7-0-0] [lt=42] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.979374] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D7-0-0] [lt=32] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:51.989646] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D8-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:51.989722] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D8-0-0] [lt=75] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:51.989757] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D8-0-0] [lt=34] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:52.000077] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D9-0-0] [lt=12] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.000150] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D9-0-0] [lt=71] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:52.000209] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57D9-0-0] [lt=56] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:52.005288] WARN [RPC] call_rpc (ob_async_rpc_proxy.h:306) [37258][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=8] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}, cluster_id=1, tenant_id=1, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.005308] WARN [RPC] call (ob_async_rpc_proxy.h:263) [37258][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=21] call rpc func failed(server="127.0.0.1:3310", timeout=2000000, cluster_id=1, tenant_id=1, arg={addr:"127.0.0.1:3310", cluster_id:1}, ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.005324] WARN [SHARE.PT] do_detect_master_rs_ls_ (ob_rpc_ls_table.cpp:290) [37258][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=12] fail to send rpc(tmp_ret=-4122, tmp_ret="OB_RPC_POST_ERROR", cluster_id=1, addr="127.0.0.1:3310", timeout=2000000, arg={addr:"127.0.0.1:3310", cluster_id:1}) [2024-05-04 05:23:52.010473] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DA-0-0] [lt=7] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.010510] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DA-0-0] [lt=37] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:52.010525] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DA-0-0] [lt=14] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:52.020759] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DB-0-0] [lt=10] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.020798] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DB-0-0] [lt=38] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:52.020828] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DB-0-0] [lt=30] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) [2024-05-04 05:23:52.041260] WARN [SHARE.PT] update (ob_rpc_ls_table.cpp:191) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DD-0-0] [lt=11] report sys_tenant's ls through rpc failed(replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, rs_addr="127.0.0.1:3310", ret=-4122, ret="OB_RPC_POST_ERROR") [2024-05-04 05:23:52.041326] WARN [SHARE.PT] update (ob_ls_table_operator.cpp:141) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DD-0-0] [lt=65] update replica failed(ret=-4122, ret="OB_RPC_POST_ERROR", replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}, inner_table_only=false) [2024-05-04 05:23:52.041366] WARN [SERVER] batch_process_tasks (ob_ls_table_updater.cpp:353) [37212][LSSysTblUp0][T0][YCEE7F000001-000616CD3B6E57DD-0-0] [lt=38] fail to update replica(ret=-4122, ret="OB_RPC_POST_ERROR", tenant_id=1, ls_id={id:1}, replica={modify_time_us:0, create_time_us:0, tenant_id:1, ls_id:{id:1}, server:"127.0.0.1:3310", sql_port:3306, role:2, member_list:[{server:"127.0.0.1:3310", timestamp:1}], replica_type:0, proposal_id:4, replica_status:"NORMAL", restore_status:{status:0}, property:{memstore_percent_:100}, unit_id:1, zone:"zone1", paxos_replica_number:1, data_size:0, required_size:0, in_member_list:false, member_time_us:0}) CRASH ERROR!!! IP=14ff20136e19, RBP=14fe8c54f7b0, sig=11, sig_code=2, sig_addr=14fee6605000, RLIMIT_CORE=unlimited, timestamp=1714771432044110, tid=37683, tname=T1_TNT_L0_G0, trace_id=14218472456193-1713921410896789-0-0, extra_info=((null)), lbt=0xb73ed98 0xb50f24a 0x14ff2026792f 0x14ff20136e19 0x5847b58 0x58459da 0x58343bf 0x5833be9 0x5831b0f 0x583032d 0x390c607 0x390ab00 0x45eb8c8 0x3902ee3 0x45ebe66 0xb5fc016 0xb5f6f59 0x14ff2025cfec 0x14ff2018e18e [2024-05-07 14:35:27.609639] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:223) [2548917][][T0][Y0-0000000000000000-0-0] [lt=14] set tenant space table name(key=14220930887511194059, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_ERROR_REAL_AGENT"}, strlen=35)