【 使用环境 】测试环境
【 OB or 其他组件 】
【 使用版本 】4.3.5
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接(右键跳转查看):
租户备份页面:
租户发起还原:
【 使用环境 】测试环境
【 OB or 其他组件 】
【 使用版本 】4.3.5
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接(右键跳转查看):
租户备份页面:
租户发起还原:
我连问题都没有看明白
租户备份能够按照备份策略执行备份,执行结果成功。但是点击发起恢复,选择日期时提示无可恢复时间,导致无法恢复。
在页面F12,利用traceid去看看ocp-server.log里获取具体日志 发下
grep ‘上一步获取的traceid‘ ocp-server.log
另外看下是obsever上是否有ob_admin工具,OCP 通过 OBServer 的 ob_admin 工具,解析备份源文件,然后根据解析结果,分析数据备份集和日志归档区间计算得到解析可恢复时间
参考这个排查下
grep 1f7c9109e41edfce ocp-server.* 日志如下
log.log (7.1 KB)
执行/root/oceanbase/bin/ob_admin dump_backup -d “/usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data”
error while loading shared libraries: libmariadb.so.3: cannot open shared object file: No such file or directory
执行如下命令
echo ‘export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/root/oceanbase/lib’ >> ~/.bash_profile
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/root/oceanbase/lib
执行之后,执行/root/oceanbase/bin/ob_admin dump_backup -d “/usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/clog”
日志如下:
log.log (93.8 KB)
ob_admin解析这个文件看下
mkdir ~/.ob_admin_log
export OB_ADMIN_LOG_DIR=~/.ob_admin_log
//usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
grep failed log.log
ocp-server.log:2025-04-21 10:32:11.910 WARN 64117 --- [http-nio-0.0.0.0-8080-exec-2,1f7c9109e41edfce,603f4ea66590714b] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=2, backupFilePath=file:///usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
ocp-server.log:2025-04-21 10:32:11.931 WARN 64117 --- [http-nio-0.0.0.0-8080-exec-2,1f7c9109e41edfce,603f4ea66590714b] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=3, backupFilePath=file:///usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
ocp-server.log:2025-04-21 10:32:11.955 WARN 64117 --- [http-nio-0.0.0.0-8080-exec-2,1f7c9109e41edfce,603f4ea66590714b] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=4, backupFilePath=file:///usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
ocp-server.log:2025-04-21 10:32:11.978 WARN 64117 --- [http-nio-0.0.0.0-8080-exec-2,1f7c9109e41edfce,603f4ea66590714b] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=5, backupFilePath=file:///usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
ocp-server.log:2025-04-21 10:32:11.978 WARN 64117 --- [http-nio-0.0.0.0-8080-exec-2,1f7c9109e41edfce,603f4ea66590714b] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file all failed, hostIdList=[2, 3, 4, 5], backupFilePath=file:///usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data
/root/oceanbase/bin/ob_admin dump_backup -d ‘/usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/clog’
/root/oceanbase/bin/ob_admin dump_backup -d ‘/usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/data’
这个命令格式写的不对,写全时这里我回复不出去消息,需要
-d "file:///xxxx"
[2025-04-21 11:39:44.487563] INFO main (main.cpp:124) [743166][][T0][Y0-0000000000000000-0-0] [lt=0] cmd: [/root/oceanbase/bin/ob_admin dump_backup -d /usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/clog ]
[2025-04-21 11:39:44.493302] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [743166][][T0][Y0-0000000000000000-0-0] [lt=45] ObSliceAlloc init finished(bsize_=7936, isize_=40, slice_limit_=7536, tmallocator_=NULL)
[2025-04-21 11:39:44.493375] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [743166][][T0][Y0-0000000000000000-0-0] [lt=32] ObSliceAlloc init finished(bsize_=7936, isize_=160, slice_limit_=7536, tmallocator_=NULL)
[2025-04-21 11:39:44.493523] ERROR issue_dba_error (ob_log.cpp:1875) [743166][][T500][Y0-0000000000000000-0-0] [lt=6][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=-9026, file="ob_storage.cpp", line_no=83, info="invalid backup uri")
[2025-04-21 11:39:44.493555] EDIAG [STORAGE] get_storage_type_from_path (ob_storage.cpp:83) [743166][][T500][Y0-0000000000000000-0-0] [lt=28][errcode=-9026] invalid backup uri(ret=-9026, uri=/usr/oceanbase/backup/sgkydb/1744016068/tenant_incarnation_1/1004/clog) BACKTRACE:0x109f85f7 0x4acc125 0x4bbbb1c 0x4bbb5ff 0x4ba8504 0x4bbb4a3 0x1082b45e 0x1082b382 0xf1050c3 0x700f378 0x6cdd051 0x1526bd23a7e5 0x4cfb51e
[2025-04-21 11:39:44.493968] WDIAG [SHARE] set (ob_backup_struct.cpp:1498) [743166][][T500][Y0-0000000000000000-0-0] [lt=408][errcode=-9026] failed to get storage type(ret=-9026)
[2025-04-21 11:39:44.493981] WDIAG [STORAGE] check_tenant_backup_path_type_ (ob_admin_dump_backup_data_executor.cpp:2737) [743166][][T500][Y0-0000000000000000-0-0] [lt=5][errcode=-9026] fail to set backup dest(ret=-9026)
[2025-04-21 11:39:44.493996] WDIAG [STORAGE] execute (ob_admin_dump_backup_data_executor.cpp:548) [743166][][T500][Y0-0000000000000000-0-0] [lt=3][errcode=-9026] fail to check tenant backup path type(ret=-9026)
[2025-04-21 11:39:44.494000] WDIAG [COMMON] main (main.cpp:160) [743166][][T500][Y0-0000000000000000-0-0] [lt=3][errcode=-9026] Fail to executor cmd, (ret=-9026)
这个 ob_admin.log和ob_admin_rs.log 麻烦发下
OCP什么版本?sgkydb业务集群OB是什么版本?
这个header_checksum -4374看起来不正常,我咨询下这块老师看看