【 使用环境 】生产环境
【 OB or 其他组件 】OB、OCP
【 使用版本 】4.5.0.0
【问题描述】
ob集群是2+2+2架构,每台服务器挂载了/data/nfs_ob_backup的NFS目录
6台服务器使用 ob_admin test_io_device -d’file:///data/nfs_ob_backup’ 通过
开启租户归档时,任务日志内出现
[obsdk] update failed, sql:[ALTER SYSTEM SET log_archive_dest = ?], error message:[PreparedStatementCallback; SQL [ALTER SYSTEM SET log_archive_dest = ?]; (conn=3221648342) Timeout; nested exception is java.sql.SQLTransientConnectionException: (conn=3221648342) Timeout]
归档任务失败
归档目录是否为空,归档目录下的文件要删除干净 再重新设置归档目录
整个NFS目录清空了也不行,应该跟集群备份报错是一个问题,集群备份时提示
设置备份路径失败,错误信息:(conn=3221605121) Timeout
show parameters like ‘%log_archive_dest%’;
SET ob_enable_show_trace=‘ON’;
ALTER SYSTEM SET log_archive_dest = ‘LOCATION=file:///data/nfs_ob_backup’;
select last_trace_id();
获取trace对应的节点
select query_sql,svr_ip from gv$ob_sql_audit where trace_id=‘获取的trace信息’;
取对应的svr_ip节点 过滤日志
grep “第三步获取的trace信息” observer.log*
grep “第三步获取的trace信息” rootservice.log*
确认参数为空,后手动黑屏设置,然后提供下日志
observer.log
[2026-04-09 11:19:57.144330] WDIAG [STORAGE] print_access_storage_log_ (ob_i_storage.cpp:938) [11033][T1_L0_G0][T1008][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=27][errcode=0] access object storage cost too much time: detect_storage_obj_meta (ob_storage.cpp:474), uri=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak, size=0 byte, start_time=1775704795090671, cost_ts=2053657 us, speed=0.00 MB/s, is_slow=1
[2026-04-09 11:19:57.144353] WDIAG [STORAGE] print_access_storage_log_ (ob_i_storage.cpp:938) [11033][T1_L0_G0][T1008][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=23][errcode=0] access object storage cost too much time: get_file_stat (ob_storage.cpp:720), uri=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak, size=0 byte, start_time=1775704795090670, cost_ts=2053683 us, speed=0.00 MB/s, is_slow=1
[YB42C0A8F472-00064EF1EB514E93-0-0
rooservice.log
[2026-04-09 11:19:55.050809] WDIAG [STORAGE.TRANS] alloc (ob_trans_define_v4.cpp:1763) [12643][T1_L0_G0][T1007][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=16][errcode=0] fail to check (tx_desc)(ret=0)
[2026-04-09 11:19:55.050838] WDIAG [SQL] move_to_sqlstat_cache (ob_sql_stat_record.cpp:328) [12643][T1_L0_G0][T1007][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=14][errcode=0] the key is not valid which at plan cache mgr(ret=0, ret=“OB_SUCCESS”)
[2026-04-09 11:19:55.053931] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:950) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=-4018] no row exist(ret=-4018)
[2026-04-09 11:19:55.053943] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:623) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=12][errcode=-4018] failed to parse row(ret=-4018, sql=select * from all_log_archive_progress where tenant_id = 1008 AND dest_no = 0, exec_tenant_id=1007)
[2026-04-09 11:19:55.053960] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:172) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=7][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1008, dest_no:0})
[2026-04-09 11:19:55.053970] WDIAG [SHARE] get_round (ob_archive_persist_helper.cpp:482) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=9][errcode=-4018] failed to get round(ret=-4018)
[2026-04-09 11:19:55.056257] INFO [SHARE] get_backup_dest_status (ob_backup_connectivity.cpp:1402) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=5] path is not exist, it’s not cleaning(ret=-4018, tenant_id=1008)
[2026-04-09 11:19:55.056281] INFO [SHARE] check_before_update_inner_config (ob_backup_config.cpp:719) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=15] backup dest is not exist, it’s a new backup dest and it is not cleaning(ret=0, tenant_id=1008, backup_dest=file:///data/nfs_ob_backup)
[2026-04-09 11:19:55.058974] WDIAG [STORAGE.TRANS] alloc (ob_trans_define_v4.cpp:1763) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=12][errcode=0] fail to check (tx_desc)(ret=0)
[2026-04-09 11:19:55.059315] INFO [SHARE] get_server_locality_info (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=15] succeed to get region and idc(addr=“192.168.244.115:2882”, region=sys_region, idc=default_idc, zone=zone1)
[2026-04-09 11:19:55.059330] INFO [SHARE] get_server_locality_info (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=14] succeed to get region and idc(addr=“192.168.244.114:2882”, region=sys_region, idc=default_idc, zone=zone1)
[2026-04-09 11:19:55.059338] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=7] succeed to get region and idc(addr=“192.168.244.119:2882”, region=sys_region, idc=default_idc, zone=zone3)
[2026-04-09 11:19:55.059345] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=7] succeed to get region and idc(addr=“192.168.244.118:2882”, region=sys_region, idc=default_idc, zone=zone3)
[2026-04-09 11:19:55.059355] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=10] succeed to get region and idc(addr=“192.168.244.117:2882”, region=sys_region, idc=default_idc, zone=zone2)
[2026-04-09 11:19:55.059364] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8] succeed to get region and idc(addr=“192.168.244.116:2882”, region=sys_region, idc=default_idc, zone=zone2)
[2026-04-09 11:19:55.075103] WDIAG [SHARE] list_directories (ob_storage_file.cpp:715) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=5][errcode=-5331] fail to operate dir entry(ret=-5331, entry.d_name=jcpt)
[2026-04-09 11:19:55.075130] INFO list_directories (ob_storage_file.cpp:727) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=25] list directories count(dir_path=/data/nfs_ob_backup/, ret=-5331)
[2026-04-09 11:19:55.075138] WDIAG [STORAGE] list_directories (ob_storage.cpp:1184) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=-5331] failed to list_files(ret=-5331, uri=file:///data/nfs_ob_backup, uri_buf=“file:///data/nfs_ob_backup/”)
[2026-04-09 11:19:55.075148] WDIAG inner_scan_dir_ (ob_object_device.cpp:792) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=10][errcode=-5331] fail to do list/dir scan!(ret=-5331, dir_name=file:///data/nfs_ob_backup, is_dir_scan=true)
[2026-04-09 11:19:55.080053] INFO mk_parent_dir (ob_backup_io_adapter.cpp:456) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8] found parent dir(i=37, path=“file:///data/nfs_ob_backup/check_file”)
[2026-04-09 11:19:55.080073] INFO [STORAGE] mkdir (ob_storage_file.cpp:309) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=12] path exist(pos=29, path=/data/nfs_ob_backup/check_file)
[2026-04-09 11:19:55.080183] INFO get_fd (ob_fd_simulator.cpp:202) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=89] fd simulator stat(used_fd_cnt=1, total_fd_cnt=300, alloc_fd_cnt=41, release_fd_cnt=40, second_array_num=1, array_size=300)
[2026-04-09 11:19:55.083725] INFO [STORAGE] print_access_storage_log (ob_storage.cpp:47) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8] access storage op=write_single_file uri=file:///data/nfs_ob_backup/check_file/1008_connect_file_20260409T111955.obbak size=128 Byte cost_ts=3561 us speed=0.03 MB/s
[2026-04-09 11:19:55.083737] INFO [SHARE] write_single_file (ob_backup_store.cpp:386) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=11] succeed to write single file.(full_path=file:///data/nfs_ob_backup/check_file/1008_connect_file_20260409T111955.obbak, serializer={cluster_name:“jcpt”, tenant_name:“jcpt”, path:“file:///data/nfs_ob_backup”, cluster_id:1732756476, tenant_id:1008, incarnation:1})
[2026-04-09 11:19:55.083749] INFO [SHARE] create_connectivity_check_file (ob_backup_connectivity.cpp:508) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=11] [BACKUP_DEST_CHECK] succeed to create new check file(path={cur_pos:77, path:“file:///data/nfs_ob_backup/check_file/1008_connect_file_20260409T111955.obbak”}, is_match=false)
[2026-04-09 11:19:55.084604] INFO [SHARE] insert_backup_storage_info (ob_backup_connectivity.cpp:1085) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=9] success insert/update backup storage info(sql=INSERT INTO all_backup_storage_info (tenant_id, path, endpoint, authorization, extension, check_file_name) VALUES (1008, ‘file:///data/nfs_ob_backup’, ‘’, ‘’, ‘’, ‘1008_connect_file_20260409T111955.obbak’) ON DUPLICATE KEY UPDATE authorization = ‘’, extension = ‘’, check_file_name = ‘1008_connect_file_20260409T111955.obbak’, tenant_id=1008, backup_dest={root_path:“file:///data/nfs_ob_backup”, storage_info:{ObObjectStorageInfo:{endpoint:"", access_id:"", extension:"", type:“FILE”, checksum_type:0, max_iops:0, max_bandwidth:0, role_arn:0x7f9090af0a38, external_id:0x7f9090af0b38, enable_worm:false}, dest_id:-1}})
[2026-04-09 11:19:55.087271] WDIAG [STORAGE.TRANS] alloc (ob_trans_define_v4.cpp:1763) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=19][errcode=0] fail to check (tx_desc)(ret=0)
[2026-04-09 11:19:55.087529] INFO [SHARE] get_server_locality_info (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=11] succeed to get region and idc(addr=“192.168.244.115:2882”, region=sys_region, idc=default_idc, zone=zone1)
[2026-04-09 11:19:55.087548] INFO [SHARE] get_server_locality_info (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=17] succeed to get region and idc(addr=“192.168.244.114:2882”, region=sys_region, idc=default_idc, zone=zone1)
[2026-04-09 11:19:55.087554] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=6] succeed to get region and idc(addr=“192.168.244.119:2882”, region=sys_region, idc=default_idc, zone=zone3)
[2026-04-09 11:19:55.087559] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=4] succeed to get region and idc(addr=“192.168.244.118:2882”, region=sys_region, idc=default_idc, zone=zone3)
[2026-04-09 11:19:55.087564] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=5] succeed to get region and idc(addr=“192.168.244.117:2882”, region=sys_region, idc=default_idc, zone=zone2)
[2026-04-09 11:19:55.087570] INFO [SHARE] get_server_locality_info_ (ob_backup_connectivity.cpp:2078) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=6] succeed to get region and idc(addr=“192.168.244.116:2882”, region=sys_region, idc=default_idc, zone=zone2)
[2026-04-09 11:19:55.087589] INFO mk_parent_dir (ob_backup_io_adapter.cpp:456) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=5] found parent dir(i=37, path=“file:///data/nfs_ob_backup/check_file”)
[2026-04-09 11:19:55.087607] INFO [STORAGE] mkdir (ob_storage_file.cpp:309) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=7] path exist(pos=29, path=/data/nfs_ob_backup/check_file)
[2026-04-09 11:19:55.092659] INFO [STORAGE] print_access_storage_log (ob_storage.cpp:47) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=7] access storage op=write_single_file uri=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak size=314 Byte cost_ts=5043 us speed=0.06 MB/s
[2026-04-09 11:19:55.092669] INFO [SHARE] write_single_file (ob_backup_store.cpp:386) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=10] succeed to write single file.(full_path=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak, serializer={tenant_id:1008})
[2026-04-09 11:19:57.093990] WDIAG [RPC] wait (ob_async_rpc_proxy.h:455) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=6][errcode=0] execute rpc failed(rc=-4012, server=“192.168.244.118:2882”, timeout=2000000, packet code=5171, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314}, ret=0)
[2026-04-09 11:19:57.094014] WDIAG [RPC] wait (ob_async_rpc_proxy.h:455) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=24][errcode=0] execute rpc failed(rc=-4012, server=“192.168.244.117:2882”, timeout=2000000, packet code=5171, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314}, ret=0)
[2026-04-09 11:19:57.094030] WDIAG [SHARE] check_server_rw_consistency_ (ob_backup_connectivity.cpp:284) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=12][errcode=0] fail to check server read & write consistency(ret=0, server=“192.168.244.115:2882”, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314})
[2026-04-09 11:19:57.094043] WDIAG [SHARE] check_server_rw_consistency_ (ob_backup_connectivity.cpp:284) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=11][errcode=0] fail to check server read & write consistency(ret=0, server=“192.168.244.114:2882”, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314})
[2026-04-09 11:19:57.094053] WDIAG [SHARE] check_server_rw_consistency_ (ob_backup_connectivity.cpp:284) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=0] fail to check server read & write consistency(ret=0, server=“192.168.244.119:2882”, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314})
[2026-04-09 11:19:57.094064] WDIAG [SHARE] check_server_rw_consistency_ (ob_backup_connectivity.cpp:284) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=9][errcode=-4012] fail to check server read & write consistency(ret=-4012, server=“192.168.244.118:2882”, arg={tenant_id:1008, backup_dest_str:“file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak”, data_checksum:4244374376, file_len:314})
[2026-04-09 11:19:57.094078] WDIAG [SHARE] schedule_check_read_write_consistency_ (ob_backup_connectivity.cpp:202) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=9][errcode=-4012] [RW CONSISTENCY CHECK] fail to check RW consistency after PUT(ret=-4012, server_list=[“192.168.244.115:2882”, “192.168.244.114:2882”, “192.168.244.119:2882”, “192.168.244.118:2882”, “192.168.244.117:2882”, “192.168.244.116:2882”], check_file_path=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak)
[2026-04-09 11:19:57.094110] WDIAG [SHARE] check_backup_dest_connectivity (ob_backup_connectivity.cpp:160) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=30][errcode=-4012] fail to check nfs connectivity(ret=-4012, tenant_id=1008, backup_dest={root_path:“file:///data/nfs_ob_backup”, storage_info:{ObObjectStorageInfo:{endpoint:"", access_id:"", extension:"", type:“FILE”, checksum_type:0, max_iops:0, max_bandwidth:0, role_arn:0x7f9090af0a38, external_id:0x7f9090af0b38, enable_worm:false}, dest_id:-1}})
[2026-04-09 11:19:57.094133] WDIAG [SHARE] check_dest_connectivity (ob_backup_store.cpp:496) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=22][errcode=-4012] fail to check backup dest connectivity(ret=-4012, tenant_id=1008, backup_dest={root_path:“file:///data/nfs_ob_backup”, storage_info:{ObObjectStorageInfo:{endpoint:"", access_id:"", extension:"", type:“FILE”, checksum_type:0, max_iops:0, max_bandwidth:0, role_arn:0x7f9090af0a38, external_id:0x7f9090af0b38, enable_worm:false}, dest_id:-1}})
[2026-04-09 11:19:57.094147] WDIAG [SHARE] check_dest_validity (ob_backup_store.cpp:523) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=13][errcode=-4012] fail to check dest connectivity(ret=-4012, backup_dest={root_path:“file:///data/nfs_ob_backup”, storage_info:{ObObjectStorageInfo:{endpoint:"", access_id:"", extension:"", type:“FILE”, checksum_type:0, max_iops:0, max_bandwidth:0, role_arn:0x7f9090af0a38, external_id:0x7f9090af0b38, enable_worm:false}, dest_id:-1}})
[2026-04-09 11:19:57.094161] WDIAG [SHARE] check_before_update_inner_config (ob_backup_config.cpp:751) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=12][errcode=-4012] fail to update archive dest config(ret=-4012, tenant_id=1008)
[2026-04-09 11:19:57.094179] WDIAG [SHARE] update_inner_config_table (ob_backup_config.cpp:374) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=-4012] fail to check before update inner config(ret=-4012)
[2026-04-09 11:19:57.094188] WDIAG [SHARE] admin_set_backup_config (ob_backup_config.cpp:1311) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=-4012] fail to update inner config table(ret=-4012)
[2026-04-09 11:19:57.094338] INFO [STORAGE.TRANS] rollback_tx (ob_tx_api.cpp:407) [12643][T1_L0_G0][T1007][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8] rollback tx(ret=0, *this={is_inited_:true, tenant_id_:1007, this:0x7f91b2004030}, tx={this:0x7f8fd2c7c030, tx_id:{txid:3024577}, state:7, addr:“192.168.244.114:2882”, tenant_id:1007, session_id:3221492827, assoc_session_id:3221492827, client_sid:3221492827, xid:NULL, xa_mode:"", xa_start_addr:“0.0.0.0:0”, access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:{branch:0, seq:1}, op_sn:4, alloc_ts:1775704795049858, active_ts:1775704795049858, commit_ts:-1, finish_ts:1775704797094043, timeout_us:9998968, lock_timeout_us:-1, expire_ts:1775704805048826, coord_id:{id:-1}, parts:[{id:{id:1}, addr:“192.168.244.115:2882”, epoch:1005066920987412, first_scn:{branch:0, seq:34901}, last_scn:{branch:0, seq:34901}, last_touch_ts:1775704795083701, flag_.flag_bit_:{is_dup_ls:0, is_clean:false}}], exec_info_reap_ts:1775704795083700, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1732756476, cluster_version:17180196864, seq_base:1775704795048798, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, conflict_txs:[], abort_cause:-6002, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], last_rc_snapshot_version:{val:1775704795081352000, v:0}, ref:2})
[2026-04-09 11:19:57.094396] WDIAG [SQL] move_to_sqlstat_cache (ob_sql_stat_record.cpp:328) [12643][T1_L0_G0][T1007][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=40][errcode=0] the key is not valid which at plan cache mgr(ret=0, ret=“OB_SUCCESS”)
[2026-04-09 11:19:57.094495] WDIAG [RS] admin_set_config (ob_root_service.cpp:8912) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=19][errcode=-4012] fail to set backup config(ret=-4012, arg={items:[{name:“log_archive_dest”, value:“LOCATION=file:///data/nfs_ob_backup”, comment:"", zone:"", server:“0.0.0.0:0”, tenant_name:"", exec_tenant_id:1008, tenant_ids:[], want_to_set_tenant_config:false}], is_inner:false})
[2026-04-09 11:19:57.094550] INFO [SHARE] add_event (ob_event_history_table_operator.h:271) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=21] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO _all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, name3, value3, value4, value5, value6, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1775704797094516), ‘root_service’, ‘admin_set_config’, ‘ret’, -4012, ‘arg’, ‘{name:“log_archive_dest”, value:“LOCATION=file:///data/nfs_ob_backup”, comment:"", zone:"", server:“0.0.0.0:0”, tenant_name:"", exec_tenant_id:1008, tenant_ids:[], want_to_set_tenant_config:false}’, ‘is_inner’, 0, ‘’, ‘’, ‘’, ‘192.168.244.114’, 2882))
[2026-04-09 11:19:57.094560] WDIAG [RS] process (ob_rs_rpc_processor.h:339) [12643][T1_L0_G0][T1][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=8][errcode=-4012] process failed(ret=-4012)
NFS服务配置如下:
/etc/exports:
/data/nfs_share 192.168.244.0/24(rw,sync,all_squash)
/etc/sysconfig/nfs:
RPCNFSDCOUNT=8
RPCNFSDARGS="-N 2 -N 3 -U"
NFSD_V4_GRACE=90
NFSD_V4_LEASE=90
客户端配置如下:
192.168.244.66:/data/nfs_share /data/nfs_ob_backup nfs4 rw,nfsvers=4.1,sync,lookupcache=positive,hard,timeo=600,wsize=1048576,rsize=1048576,namlen=255 0 0
- 6台observer 的 df -h 截图看下。
- 每个实例进入挂在的节点进行 touch hh 看看能不能成功, 成功后都删除
117,118节点确认一下 路径 /data/nfs_ob_backup ,是否权限一致。
访问这俩节点报错RPC超时
挂载的磁盘是不是性能是不是比较差?
show parameters like ‘%log_archive_dest%’;
如果存在已有路径,删除 OCP 的备份策略设置为空重新跑一遍试试
从图里看偶发性存在超过 2 秒情况,判定RPC超时设置的为2s,日志中也抛出了,cost_ts=2053657 us大于2s。
[2026-04-09 11:19:57.144330] WDIAG [STORAGE] print_access_storage_log_ (ob_i_storage.cpp:938) [11033][T1_L0_G0][T1008][YB42C0A8F472-00064EF1EB514E93-0-0] [lt=27][errcode=0] access object storage cost too much time: detect_storage_obj_meta (ob_storage.cpp:474), uri=file:///data/nfs_ob_backup/check_file/1008_nfs_connectivity_check_1775704795087576.obbak, size=0 byte, start_time=1775704795090671, cost_ts=2053657 us, speed=0.00 MB/s, is_slow=1
请问这个超时2s能否改长一点
请问这个超时2s能否改长一点或者别的方法?
这个2s判定无法修改。推荐你使用obdiag先做一下巡检

