ocp备份恢复，在租户界面备份后想要恢复发现源租户部分是空白的

OceanBase 技术问题
,
#25

我咨询下相关老师，有进展回复你

#26

怀疑是备份文件没识别到，麻烦按如下步骤排查下，
在自己页面F12，利用traceid去看看ocp-server.log里获取具体日志 发下
grep ‘上一步获取的traceid‘ ocp-server.log

image
image1920×1007 151 KB

1 个赞
#27

这个问题有进展吗

#28

不好意思之前一直在忙，下面是grep出的日志
2024-08-27 08:29:35.894 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/3/backup/info?timeScopeType=LATEST_SEVEN_DAYS&startTime=2024-08-21T00%3A00%3A00%2B08%3A00&endTime=2024-08-27T23%3A59%3A59%2B08%3A00, client=192.168.30.43, traceId=a7beae0f1b1b106e, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.parseBackupInfo(long,long,OffsetDateTime,OffsetDateTime,ObQueryTimeScopeType), args=1,3,2024-08-21T00:00+08:00,2024-08-27T23:59:59+08:00,LATEST_SEVEN_DAYS,]
2024-08-27 08:29:35.894 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.oceanbase.backup.core.model.TimeScope : normalize time scope (startTime=2024-08-21T00:00+08:00, endTime=2024-08-27T23:59:59+08:00): passed
2024-08-27 08:29:35.916 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.BackupStrategyManagerFactory : isPhysical=true, isLogical=false, isPhysicalAndWasLogical=false
2024-08-27 08:29:35.925 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.BackupStrategyManagerFactory : isPhysical=true, isLogical=false, isPhysicalAndWasLogical=false
2024-08-27 08:29:35.938 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1
2024-08-27 08:29:35.940 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1
2024-08-27 08:29:35.960 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.66.150:62888/api/v1/backup/file/dumpPhysicalCheck, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/home/admin/oceanbase, dataPath=/data/observer/1, logPath=/redo/observer/log1, diskPathStyle=DEFAULT, runPath=/home/admin/oceanbase), backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data, storageOption=, runUser=admin), params:null
2024-08-27 08:29:36.128 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.b.c.d.m.PhysicalBackupFileCheckInfo : uri=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data.
2024-08-27 08:29:36.128 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.b.c.d.m.PhysicalBackupFileCheckInfo : is_exist=true .
2024-08-27 08:29:36.133 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1
2024-08-27 08:29:36.135 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1
2024-08-27 08:29:36.144 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.66.150:62888/api/v1/backup/file/dumpPhysical, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/home/admin/oceanbase, dataPath=/data/observer/1, logPath=/redo/observer/log1, diskPathStyle=DEFAULT, runPath=/home/admin/oceanbase), backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data, storageOption=, runUser=admin), params:null
2024-08-27 08:29:36.701 WARN 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=1, backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data
2024-08-27 08:29:36.706 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2
2024-08-27 08:29:36.708 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 2
2024-08-27 08:29:36.729 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.66.151:62888/api/v1/backup/file/dumpPhysical, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/home/admin/oceanbase, dataPath=/data/observer/1, logPath=/redo/observer/log1, diskPathStyle=DEFAULT, runPath=/home/admin/oceanbase), backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data, storageOption=, runUser=admin), params:null
2024-08-27 08:29:37.466 WARN 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=2, backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data
2024-08-27 08:29:37.472 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3
2024-08-27 08:29:37.475 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 3
2024-08-27 08:29:37.496 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.66.152:62888/api/v1/backup/file/dumpPhysical, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/home/admin/oceanbase, dataPath=/data/observer/1, logPath=/redo/observer/log1, diskPathStyle=DEFAULT, runPath=/home/admin/oceanbase), backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data, storageOption=, runUser=admin), params:null
2024-08-27 08:29:37.921 WARN 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file failed, hostId=3, backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data
2024-08-27 08:29:37.921 WARN 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.d.f.physical.BackupFileDumper : try dump backup file all failed, hostIdList=[1, 2, 3], backupFilePath=file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data
2024-08-27 08:29:37.921 ERROR 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.b.i.d.info.BackupInfoServiceImpl : [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_FILE_DUMP_FILE_ERROR, args=[1, 2, 3],file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1004/data
2024-08-27 08:29:37.921 INFO 174475 — [http-nio-0.0.0.0-18080-exec-2,a7beae0f1b1b106e,c938922e04683be2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/3/backup/info client=192.168.30.43, traceId=a7beae0f1b1b106e, duration=2032 ms]

1 个赞
#29

好的，我联系熟悉这块的老师继续看下

#30

OCP 通过 OBServer 的 ob_admin 工具，解析备份源文件，然后根据解析结果，分析数据备份集和日志归档区间计算得到解析可恢复时间，执行下面命令 确认下 备份集信息是否准确

/home/admin/oceanbase/bin/ob_admin dump_backup -d “file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1002/data”

/home/admin/oceanbase/bin/ob_admin dump_backup -d “file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1002/clog”

2 个赞
#31

这里的租户ID可以换成你需要的租户ID

租户备份成功，但是发起还原时提示无可恢复时间
#32

ocp上没有ob_admin这个命令

image
image1861×97 10.8 KB

#33

就是这里的ob_admin

#34

image
image1742×244 21.3 KB

image
image1730×175 16 KB

报错了

#35

使用admin用户

#36

用admin用户也这样

image
image1752×820 64 KB

#37

将 OceanBase 数据库的 LIB 加到环境变量 LD_LIBRARY_PATH 中，按实际路径替换下面路径即可。

echo ‘export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/admin/oceanbase/lib’ >> ~/.bash_profile

–
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/admin/oceanbase/lib

#38

执行完1004的租户可以恢复了，但是我用1012这个租户同样步骤测试还是不行
1004_data.txt (227.7 KB)
1004_clog.txt (123.8 KB)
1012_clog.txt (355.0 KB)
1012_data.txt (1.0 MB)

image
image1836×832 54.5 KB

image
image1806×778 50.9 KB

1 个赞
#39

好的，我们分析下

Ocp 4.3.5 集群发起恢复异常
#41

今天上去发现都有了。就是这sys租户备份怎么感觉不太对，我看上面写了sys租户不支持备份，为啥他还是会发起备份任务，而且一下子发起好多次，备份路径也没有。

image
image1533×477 10.5 KB

image
image1810×874 61.5 KB

#42

“今天上去发现都有了” --有做什么操作吗？

sys租户备份的疑问 --SYS租户的情况比较特殊，由于SYS租户下没有日志流需要参与备份，而为了维护租户状态的统一以及展示的需要，让SYS租户定期汇总所有其他租户的<archive_start_ts, archive_checkpoint_ts>，取SYS租户的archive_start_ts是所有其他租户中的最大archive_start_ts，archive_checkpoint_ts是所有其他租户中的最小的archive_checkpoint_ts。

#43

没做啥操作，就上周按要求吧OB的LIB加到LD_LIBRARY_PATH下，然后执行了这两个命令
/home/admin/oceanbase/bin/ob_admin dump_backup -d “file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1002/data”

/home/admin/oceanbase/bin/ob_admin dump_backup -d “file:///obbackup/Mccbts_OB_Server_Cluster/1/tenant_incarnation_1/1002/clog”