用的好好的一两天数据库就连接不上了 obproxy一直报错

【 使用环境 】生产环境 or 测试环境
【 OB or 其他组件 】
【 使用版本 】社区版
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【问题现象及影响】

[2023-07-20 03:25:35.006135] INFO  [PROXY] ob_config_server_processor.cpp:378 [5478][Y0-00007FDCD9606360] [lt=66] [dc=0] can not find region from id list, ignore(sub_cluster_info={cluster_id:0, is_used:false, role:1, web_rs_list:[[0]{server:"192.168.1.20:2881", is_dup_replica:false, role:"LEADER", type:"FULL"}, [1]{server:"192.168.1.21:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}, [2]{server:"192.168.1.22:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}], rs_list_hash:0, create_failure_count:0, idc_list:[]}, idc_name=zue)
[2023-07-20 03:25:35.025898] INFO  [PROXY] ob_config_server_processor.cpp:378 [5478][Y0-00007FDCD9606360] [lt=29] [dc=0] can not find region from id list, ignore(sub_cluster_info={cluster_id:0, is_used:false, role:1, web_rs_list:[[0]{server:"192.168.1.20:2881", is_dup_replica:false, role:"LEADER", type:"FULL"}, [1]{server:"192.168.1.21:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}, [2]{server:"192.168.1.22:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}], rs_list_hash:0, create_failure_count:0, idc_list:[]}, idc_name=zue)
[2023-07-20 03:25:35.026241] INFO  [PROXY] ob_config_server_processor.cpp:378 [5483][Y0-00007FDCD8F521E0] [lt=23] [dc=0] can not find region from id list, ignore(sub_cluster_info={cluster_id:0, is_used:false, role:1, web_rs_list:[[0]{server:"192.168.1.20:2881", is_dup_replica:false, role:"LEADER", type:"FULL"}, [1]{server:"192.168.1.21:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}, [2]{server:"192.168.1.22:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}], rs_list_hash:0, create_failure_count:0, idc_list:[]}, idc_name=zue)
.......................


 
[2023-07-20 02:31:14.146037] WARN  [PROXY.TXN] handle_error_resp (ob_mysql_transact.cpp:4141) [5442][Y0-00007FDCD9606420] [lt=18] [dc=0] get err pkt from observer, not forward to client, will be consumed soon, and maybe need retry(send_action="SERVER_SEND_LOGIN", state="RESPONSE_ERROR", error_type="LOGIN_SERVER_INIT_ERROR", resp={is_trans_completed:true, is_resp_completed:true, ending_type:2, is_partition_hit:true, has_new_sys_var:false, has_proxy_idc_name_user_var:false, is_server_db_reset:false, reserved_len:0, connection_id:0, scramble_buf:"", is_resultset_resp:false, server_capabilities_lower_.capability:0, ok_packet_action_type:2, last_ok_pkt_len:12, rewritten_last_ok_pkt_len:0, extra_info:{is_exist_sess_info:false, sess_info_count:0, extra_len:0}, error_pkt:field_count:255, errcode:8001, sqlstate:"08004", message:"Server is initializing"})

【附件】

observer上去找日志,error级别日志应该是会有线索

[root@obs1 log]# tail -n 2000 -f observer.log |grep ERROR
[2023-07-21 09:33:03.784450] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=14][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file="palf_iterator.h", line_no=252, info="invliad data or checksum error!!!")
[2023-07-21 09:33:09.662327] ERROR issue_dba_error (ob_log.cpp:1792) [17288][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file="palf_iterator.h", line_no=252, info="invliad data or checksum error!!!")
[2023-07-21 09:33:13.218660] ERROR issue_dba_error (ob_log.cpp:1792) [16310][T1_ReplaySrv6][T1][Y0-0000000000000000-0-0] [lt=37][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file="palf_iterator.h", line_no=252, info="invliad data or checksum error!!!")
[2023-07-21 09:33:14.746534] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file="palf_iterator.h", line_no=252, info="invliad data or checksum error!!!")
[2023-07-21 09:33:25.330964] ERROR issue_dba_error (ob_log.cpp:1792) [17288][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file="palf_iterator.h", line_no=252, info="invliad data or checksum error!!!")
日志太多了筛选了error  tail -n 2000 -f observer.log |grep ERROR

重复问题合并处理

https://ask.oceanbase.com/t/topic/35604053/2