ocp 社区版备份恢复使用自建s3作为存储介质失败

AntTech_8PQJNG · 2025 年2 月 12 日 14:28

【使用环境】测试环境
【 OB or 其他组件】ocp
【使用版本】社区版4.3.2-20241012145836
【问题描述】ocp 社区版备份恢复使用自建s3作为存储介质失败

存储目录是obback

看到社区有别的用户也出现这个问题，说不测试直接备份，我尝试了也不可以

旭辉 · 2025 年2 月 12 日 14:50

麻烦使用test_io_device命令测试下连通性及备份介质权限等

1. cd /home/admin/oceanbase/bin
    mkdir ob_admin_log
2. export OB_ADMIN_LOG_DIR=./ob_admin_log
3. ./ob_admin test_io_device \
    -d's3://test-bucket/test/path' \
    -s'host=http://oss-cn-hangzhou.aliyuncs.com&access_id=111&access_key=222'  --替换为你实际的s3路径和host

4.将测试结果及ob_admin_log目录下的ob_admin.log发下

https://www.oceanbase.com/docs/common-oceanbase-database-cn-1000000002016161

旭辉 · 2025 年2 月 12 日 14:55

另外确认下您这里访问域名是http还是https？

AntTech_8PQJNG · 2025 年2 月 12 日 15:04

我这边执行报错
./ob_admin: error while loading shared libraries: libmariadb.so.3: cannot open shared object file: No such file or directory

AntTech_8PQJNG · 2025 年2 月 12 日 15:05

http

旭辉 · 2025 年2 月 12 日 15:08

设置环境变量再试下

export LD_LIBRARY_PATH=/home/admin/oceanbase/lib  --跟据实际路径修改

echo $LD_LIBRARY_PATH

AntTech_8PQJNG · 2025 年2 月 12 日 15:10

还是一样

旭辉 · 2025 年2 月 12 日 15:12

ocp4.3.2版本对s3 http支持是有bug的，在ocp4.3.3版本修复，建议使用ocp 4.3.3版本，即使升级到4.3.3版本，也需要保证连通性及备份介质权限没问题，可以先试用test_io_device测试下看看

旭辉 · 2025 年2 月 12 日 15:15

看到是使用root部署的OB，你这里执行命令就不需要sudo了

AntTech_8PQJNG · 2025 年2 月 12 日 15:20

升级ocp风险大吗

旭辉 · 2025 年2 月 12 日 15:28

ocp升级还是比较简单的，参考下
https://www.oceanbase.com/docs/common-ocp-1000000002078176

如果升级建议升级到OCP 4.3.4版本

独善其身 · 2025 年2 月 16 日 10:38

还是感觉权限的问题

Boomballa · 2025 年4 月 21 日 15:58

大佬，您好，我这边是

CentOS系统
OCP 4.3.5的版本
Minio S3存储

S3用户权限设置

OCP备份配置

备份错误显示

我也按照测试方式去测试了一下
./ob_admin test_io_device
-d’s3://obbackup-bucket/newsrec_obbackup/’
-s’host=http://minio-content.service.xxx.org:8380&access_id=xxxx&access_key=xxxxxx’

测试结果

image1165×66 13.9 KB

日志如下：
ob_admin_rs.log (4.0 KB)
ob_admin.log (94.3 KB)

可以帮忙看看是哪里的问题么？

旭辉 · 2025 年4 月 21 日 16:20

从ob_admin.log看有两个报错，第2个报错麻烦先用aws的命令行工具测试下兼容性吧，list接口。

https://docs.aws.amazon.com/cli/latest/reference/s3/

另外你重新发个帖子吧

报错1:

[2025-04-21 15:48:55.444944] WDIAG [LIB] ObPool (ob_pool.ipp:37) [785583][][T500][Y0-0000000000000000-0-0] [lt=18][errcode=-4016] obj size larger than block size(obj_size_=7960, block_size_=7936)
[2025-04-21 15:48:55.444963] WDIAG [LIB] ObPool (ob_pool.ipp:37) [785583][][T500][Y0-0000000000000000-0-0] [lt=19][errcode=-4016] obj size larger than block size(obj_size_=8536, block_size_=7936)
[2025-04-21 15:48:55.444969] WDIAG [LIB] ObPool (ob_pool.ipp:37) [785583][][T500][Y0-0000000000000000-0-0] [lt=5][errcode=-4016] obj size larger than block size(obj_size_=10192, block_size_=7936)

报错2:

[2025-04-21 15:48:55.449388] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=8][errcode=-9105] [S3] module=CurlHttpClient, msg=Curl returned error code 6 - Error
[2025-04-21 15:48:55.449445] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=13][errcode=-9105] [S3] module=AWSXmlClient, msg=HTTP response code: -1
Resolved remote host IP address: 
Request ID: 
Exception name: 
Error message: curlCode: 6, Error
0 response headers:
[2025-04-21 15:48:55.449487] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] [S3] module=AWSClient, msg=If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
[2025-04-21 15:48:55.449497] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=5][errcode=-9105] [S3] module=AWSClient, msg=Request failed, now waiting 0 ms before attempting again.
[2025-04-21 15:48:55.450307] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=4][errcode=-9105] [S3] module=CurlHttpClient, msg=Curl returned error code 6 - Error
[2025-04-21 15:48:55.450351] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=10][errcode=-9105] [S3] module=AWSXmlClient, msg=HTTP response code: -1
Resolved remote host IP address: 
Request ID: 
Exception name: 
Error message: curlCode: 6, Error
0 response headers:
[2025-04-21 15:48:55.450390] WDIAG Log (ob_storage_s3_base.cpp:68) [785583][][T500][Y0-0000000000000000-0-0] [lt=15][errcode=-9105] [S3] module=AWSClient, msg=If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
[2025-04-21 15:48:55.450422] WDIAG log_s3_status (ob_storage_s3_base.cpp:655) [785583][][T500][Y0-0000000000000000-0-0] [lt=5][errcode=-9105] S3 info(request_id="", code=-1, exception="", err_msg="curlCode: 6, Error")
[2025-04-21 15:48:55.450434] WDIAG do_list_ (ob_storage_s3_base.cpp:1049) [785583][][T500][Y0-0000000000000000-0-0] [lt=11][errcode=-9105] failed to list s3 objects(ret=-9105, bucket=obbackup-bucket, object=newsrec_obbackup/2025-04-21-15:48:55/, max_list_num=1000, delimiter=NULL)
[2025-04-21 15:48:55.450454] WDIAG list_files_ (ob_storage_s3_base.cpp:1517) [785583][][T500][Y0-0000000000000000-0-0] [lt=17][errcode=-9105] fail to list s3 objects(ret=-9105, uri=s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55/)
[2025-04-21 15:48:55.450478] WDIAG [STORAGE] list_files (ob_storage.cpp:704) [785583][][T500][Y0-0000000000000000-0-0] [lt=8][errcode=-9105] fail to list files(ret=-9105, uri=s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55)
[2025-04-21 15:48:55.450491] WDIAG inner_scan_dir_ (ob_object_device.cpp:633) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] fail to do list/dir scan!(ret=-9105, is_dir_scan=false, dir_name=s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55)
[2025-04-21 15:48:55.450502] WDIAG is_empty_directory (ob_backup_io_adapter.cpp:738) [785583][][T500][Y0-0000000000000000-0-0] [lt=10][errcode=-9105] fail to scan dir!(ret=-9105, uri=s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55)
[2025-04-21 15:48:55.450515] WDIAG [STORAGE] test_backup_dest_connectivity_ (ob_admin_test_io_device_executor.cpp:128) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] failed check backup dest is empty dir(ret=-9105, backup_path="s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55")
[2025-04-21 15:48:55.450564] WDIAG [STORAGE] run_all_tests_ (ob_admin_test_io_device_executor.cpp:105) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] test backup dest connectivity failed(ret=-9105, backup_path="s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55")
[2025-04-21 15:48:55.450575] WDIAG [STORAGE] execute (ob_admin_test_io_device_executor.cpp:50) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] failed to pass all tests(ret=-9105, backup_path="s3://obbackup-bucket/newsrec_obbackup/2025-04-21-15:48:55")
[2025-04-21 15:48:55.450584] WDIAG [COMMON] main (main.cpp:160) [785583][][T500][Y0-0000000000000000-0-0] [lt=7][errcode=-9105] Fail to executor cmd, (ret=-9105)

ocp 社区版 备份恢复使用 自建s3作为存储介质失败

ocp 社区版备份恢复使用自建s3作为存储介质失败