请问这种情况怎么处理?
【 使用环境 】生产环境
【 OB 】
【 使用版本 】4.2.1.1
【问题描述】设置归档备份路径为腾讯云cos时出错, ALTER SYSTEM SET LOG_ARCHIVE_DEST=‘LOCATION=cos://…’ TENANT=tenant_name;错误信息:ERROR 9060 (HY000): COS error
【复现路径】按文档操作
【问题现象及影响】按文档设置归档备份路径,使用腾讯云cos,查询log也没有有效信息。
【附件】
请问这种情况怎么处理?
【 使用环境 】生产环境
【 OB 】
【 使用版本 】4.2.1.1
【问题描述】设置归档备份路径为腾讯云cos时出错, ALTER SYSTEM SET LOG_ARCHIVE_DEST=‘LOCATION=cos://…’ TENANT=tenant_name;错误信息:ERROR 9060 (HY000): COS error
【复现路径】按文档操作
【问题现象及影响】按文档设置归档备份路径,使用腾讯云cos,查询log也没有有效信息。
【附件】
搜下rootservice.log 看下呢
[2023-11-20 14:16:04.211133] INFO [STORAGE] set (ob_storage_info.cpp:127) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=18] succ to parse storage info(device_type=2, endpoint=“host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com”, access_id=“access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG”, extension=“appid=xxxxxx”)
[2023-11-20 14:16:04.212679] WDIAG [SHARE] parse_one_row_ (ob_inner_table_operator.cpp:945) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=23][errcode=-4018] no row exist(ret=-4018)
[2023-11-20 14:16:04.212698] WDIAG [SHARE] do_get_row_ (ob_inner_table_operator.cpp:618) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=18][errcode=-4018] failed to parse row(ret=-4018, sql=select * from all_log_archive_progress where tenant_id = 1016 AND dest_no = 0, exec_tenant_id=1015)
[2023-11-20 14:16:04.212722] WDIAG [SHARE] get_row (ob_inner_table_operator.cpp:174) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=9][errcode=-4018] failed to get row(ret=-4018, need_lock=false, key={tenant_id:1016, dest_no:0})
[2023-11-20 14:16:04.212739] WDIAG [SHARE] get_round (ob_archive_persist_helper.cpp:488) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=16][errcode=-4018] failed to get round(ret=-4018)
[2023-11-20 14:16:04.212752] INFO [STORAGE] set (ob_storage_info.cpp:127) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=6] succ to parse storage info(device_type=2, endpoint=“host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com”, access_id=“access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG”, extension=“appid=xxxxxx”)
[2023-11-20 14:16:04.212766] INFO [STORAGE] set (ob_storage_info.cpp:127) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=7] succ to parse storage info(device_type=2, endpoint=“host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com”, access_id=“access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG”, extension=“appid=xxxxxx”)
[2023-11-20 14:16:04.242163] WDIAG list_objects (ob_storage_cos_base.cpp:584) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=4][errcode=-9060] fail to list objects(ret=-9060, uri=cos://obbackup-xxxxxx/backup/payment/archive)
[2023-11-20 14:16:04.242182] WDIAG list_files (ob_storage_cos_base.cpp:397) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=19][errcode=-9060] fail to list object in cos_base(ret=-9060, uri=cos://obbackup-xxxxxx/backup/payment/archive, tmp_dir=backup/payment/archive/)
[2023-11-20 14:16:04.242194] WDIAG [STORAGE] list_files (ob_storage.cpp:406) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=8][errcode=-9060] failed to list_files(ret=-9060, uri=cos://obbackup-xxxxxx/backup/payment/archive)
[2023-11-20 14:16:04.242203] WDIAG scan_dir (ob_object_device.cpp:411) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=7][errcode=-9060] fail to do list/dir scan!(ret=-9060, is_dir_scan=false, dir_name=cos://obbackup-xxxxxx/backup/payment/archive)
[2023-11-20 14:16:04.242210] WDIAG is_empty_directory (ob_backup_io_adapter.cpp:592) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=6][errcode=-9060] fail to scan dir!(ret=-9060, uri=cos://obbackup-xxxxxx/backup/payment/archive)
[2023-11-20 14:16:04.242225] WDIAG [SHARE] dest_is_empty_directory (ob_backup_store.cpp:243) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=12][errcode=-9060] fail to init store(ret=-9060, backup_dest={root_path:“cos://obbackup-xxxxxx/backup/payment/archive”, storage_info:{endpoint:“host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com”, access_id:“access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG”, extension:“appid=xxxxxx”, type:“COS”}})
[2023-11-20 14:16:04.242236] WDIAG [SHARE] check_dest_validity (ob_backup_store.cpp:435) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=11][errcode=-9060] fail to check dest is empty dirctory(ret=-9060, backup_dest={root_path:“cos://obbackup-xxxxxx/backup/payment/archive”, storage_info:{endpoint:“host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com”, access_id:“access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG”, extension:“appid=xxxxxx”, type:“COS”}})
[2023-11-20 14:16:04.242256] WDIAG [SHARE] check_before_update_inner_config (ob_backup_config.cpp:654) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=17][errcode=-9060] fail to update archive dest config(ret=-9060, tenant_id=1016)
[2023-11-20 14:16:04.242264] WDIAG [SHARE] update_inner_config_table (ob_backup_config.cpp:367) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=6][errcode=-9060] fail to check before update inner config(ret=-9060)
[2023-11-20 14:16:04.242279] WDIAG [RS] admin_set_backup_config (ob_root_service.cpp:10313) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=14][errcode=-9060] fail to update inner config table(ret=-9060)
[2023-11-20 14:16:04.242342] INFO [STORAGE.TRANS] rollback_tx (ob_tx_api.cpp:333) [280679][T1_L0_G0][T1015][YB420A05820C-00060A477C7F06F3-0-0] [lt=5] rollback tx(ret=0, *this={is_inited:true, tenant_id:1015, this:0x7f71eca04030}, tx={this:0x7f70f8d1bce0, tx_id:{txid:44001167}, state:7, addr:“10.5.130.12:2882”, tenant_id:1015, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:“0.0.0.0:0”, access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:1700460964210109, op_sn:3, alloc_ts:1700460964210044, active_ts:1700460964211090, commit_ts:-1, finish_ts:1700460964241979, timeout_us:9999208, lock_timeout_us:-1, expire_ts:1700460974210298, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1, cluster_version:17180000513, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:true, cflict_txs:[], abort_cause:-6002, commit_expire_ts:0, commit_task_.is_registered():false, ref:2})
[2023-11-20 14:16:04.242435] WDIAG [RS] admin_set_config (ob_root_service.cpp:8113) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=41][errcode=-9060] fail to set backup config(ret=-9060, arg={items:[{name:“log_archive_dest”, value:“LOCATION=cos://obbackup-xxxxxx/backup/payment/archive?host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com&access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG&access_key=OenmbEhKwTvHWdltseDYfYDerrdEcpoZ&appid=xxxxxx”, comment:"", zone:"", server:“0.0.0.0:0”, tenant_name:“payment”, exec_tenant_id:1, tenant_ids:[], want_to_set_tenant_config:false}], is_inner:false})
[2023-11-20 14:16:04.242486] INFO [SHARE] add_event (ob_event_history_table_operator.h:289) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=19] event table add task(ret=0, event_table_name="__all_rootservice_event_history", sql=INSERT INTO all_rootservice_event_history (gmt_create, module, event, name1, value1, name2, value2, rs_svr_ip, rs_svr_port) VALUES (usec_to_time(1700460964242456), ‘root_service’, ‘admin_set_config’, ‘ret’, -9060, ‘arg’, ‘{items:[{name:“log_archive_dest”, value:“LOCATION=cos://obbackup-xxxxxx/backup/payment/archive?host=obbackup-xxxxxx.cos.ap-shenzhen-fsi.myqcloud.com&access_id=AKIDwjH3jCRSFpBJDXXXXXXXsiQAnG&access_key=OenmbEhKwTvHWdltseDYfYDerrdEcpoZ&appid=xxxxxx”, comment:"", zone:"", server:“0.0.0.0:0”, tenant_name:“payment”, exec_tenant_id:1, tenant_ids:[], want_to_set_tenant_config:false}], is_inner:false}’, ‘10.5.130.12’, 2882))
[2023-11-20 14:16:04.242519] WDIAG [RS] process (ob_rs_rpc_processor.h:212) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=32][errcode=-9060] process failed(ret=-9060)
[2023-11-20 14:16:04.242532] INFO [RS] process (ob_rs_rpc_processor.h:232) [280679][T1_L0_G0][T1][YB420A05820C-00060A477C7F06F3-0-0] [lt=12] [DDL] execute ddl like stmt(ret=-9060, cost=32078, ddl_arg=NULL)
backup/payment/archive路径我是手工创建了的,帮忙看看是什么问题?
再查查有没有connect相关的日志? 是走的cos的外网ip吗,有可能网络限流了
connect日志在哪查?我用的是主账号,限流这个怎么说?
按cos文档,是这么说的:“您在内网环境下通过该域名访问 COS 时,COS 会智能解析到内网 IP 上。”
我是在内网环境使用
先查下上面这个报错日志附近的observer和rs日志,看下有没有HttpIoError的关键字
没有发现HttpIoError关键字的日志
稍等,我找个cos备份的相关同学帮忙看下
status->error_code和 status->error_msg这两个关键字搜一下看看呢
也是没有搜到
那再搜搜 “list_objects.*ob_cos_wrapper.cpp” 看看,observer和rs日志都搜一下
搜出来了,这么看是少了个region参数?文档里没有这个参数设置
status->error_code: InvalidRegionName
status->error_msg: The specified region is invalid or unreachable.
这个应该是COS使用姿势的问题,可能host设置错了或者不可访问,你看看COS使用上有没有什么问题?