开启日志归档后，运行了一段时间发现自动删除结果不符合预期策略

OceanBase 技术问题
#1

归档设置保留7天，但是目前保留了10天。起见做过全量备份和增量备份。
OBServer版本：5.7.25-OceanBase_CE-v4.3.5.3

 SELECT * FROM oceanbase.DBA_OB_ARCHIVE_DEST;
0 binding OPTIONAL
0 dest_id 1002
0 path s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn&access_id=&access_key=&delete_mode=delete&checksum_type=md5
0 piece_switch_interval 1d
0 state ENABLE 
 select * from oceanbase.DBA_OB_BACKUP_DELETE_POLICY;
POLICY_NAME RECOVERY_WINDOW
default 7d 
 SELECT * FROM oceanbase.DBA_OB_ARCHIVELOG_PIECE_FILES;
1001 1 1 1 0 FROZEN 1764911836868903000 2025-12-05 13:17:16.868903 1764911836868903000 2025-12-05 13:17:16.868903 1764912197095210001 1764998236868903000 2025-12-06 13:17:16.868903 1 1 none 17199625 16.40MB 17199625 16.40MB 1.00 INCOMPLETE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1.cmecloud.cn
1002 2 2 1 0 FROZEN 1764912398043377000 2025-12-05 13:26:38.043377 1764998797979623004 2025-12-06 13:26:37.979623 1764998797979623004 1764998798043377000 2025-12-06 13:26:38.043377 1 1 none 2103816083 1.96GB 2103816083 1.96GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 3 1 0 FROZEN 1764998798043377000 2025-12-06 13:26:38.043377 1765085197967984004 2025-12-07 13:26:37.967984 1765085197967984004 1765085198043377000 2025-12-07 13:26:38.043377 1 1 none 2015529949 1.88GB 2015529949 1.88GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 4 1 0 FROZEN 1765085198043377000 2025-12-07 13:26:38.043377 1765171597941000003 2025-12-08 13:26:37.941000 1765171597941000003 1765171598043377000 2025-12-08 13:26:38.043377 1 1 none 2289684686 2.13GB 2289684686 2.13GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 5 1 0 FROZEN 1765171598043377000 2025-12-08 13:26:38.043377 1765257997984619003 2025-12-09 13:26:37.984619 1765257997984619004 1765257998043377000 2025-12-09 13:26:38.043377 1 1 none 2112651128 1.97GB 2112651128 1.97GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 6 1 0 FROZEN 1765257998043377000 2025-12-09 13:26:38.043377 1765344398005224002 2025-12-10 13:26:38.005224 1765344398005224003 1765344398043377000 2025-12-10 13:26:38.043377 1 1 none 2098899952 1.95GB 2098899952 1.95GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 7 1 0 FROZEN 1765344398043377000 2025-12-10 13:26:38.043377 1765430797990928004 2025-12-11 13:26:37.990928 1765430797990928004 1765430798043377000 2025-12-11 13:26:38.043377 1 1 none 2095771603 1.95GB 2095771603 1.95GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 8 1 0 FROZEN 1765430798043377000 2025-12-11 13:26:38.043377 1765517197492251004 2025-12-12 13:26:37.492251 1765517197492251005 1765517198043377000 2025-12-12 13:26:38.043377 1 1 none 2080632586 1.94GB 2080632586 1.94GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 9 1 0 FROZEN 1765517198043377000 2025-12-12 13:26:38.043377 1765603597951047000 2025-12-13 13:26:37.951047 1765603597951047001 1765603598043377000 2025-12-13 13:26:38.043377 1 1 none 2259707966 2.10GB 2259707966 2.10GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 10 1 0 FROZEN 1765603598043377000 2025-12-13 13:26:38.043377 1765689998042565000 2025-12-14 13:26:38.042565 1765689998042565000 1765689998043377000 2025-12-14 13:26:38.043377 1 1 none 2045534991 1.91GB 2045534991 1.91GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 11 1 0 FROZEN 1765689998043377000 2025-12-14 13:26:38.043377 1765776397914838004 2025-12-15 13:26:37.914838 1765776397914838004 1765776398043377000 2025-12-15 13:26:38.043377 1 1 none 2319615405 2.16GB 2319615405 2.16GB 1.00 DELETED s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 12 1 0 FROZEN 1765776398043377000 2025-12-15 13:26:38.043377 1765862797929465004 2025-12-16 13:26:37.929465 1765862797929465005 1765862798043377000 2025-12-16 13:26:38.043377 1 1 none 2189960955 2.04GB 2189960955 2.04GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 13 1 0 FROZEN 1765862798043377000 2025-12-16 13:26:38.043377 1765949197918670004 2025-12-17 13:26:37.918670 1765949197918670004 1765949198043377000 2025-12-17 13:26:38.043377 1 1 none 2151258075 2.00GB 2151258075 2.00GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 14 1 0 FROZEN 1765949198043377000 2025-12-17 13:26:38.043377 1766035597932206005 2025-12-18 13:26:37.932206 1766035597932206005 1766035598043377000 2025-12-18 13:26:38.043377 1 1 none 2110423635 1.97GB 2110423635 1.97GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 15 1 0 FROZEN 1766035598043377000 2025-12-18 13:26:38.043377 1766121997969949005 2025-12-19 13:26:37.969949 1766121997969949005 1766121998043377000 2025-12-19 13:26:38.043377 1 1 none 2103808210 1.96GB 2103808210 1.96GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 16 1 0 FROZEN 1766121998043377000 2025-12-19 13:26:38.043377 1766208398015452004 2025-12-20 13:26:38.015452 1766208398015452004 1766208398043377000 2025-12-20 13:26:38.043377 1 1 none 2081402729 1.94GB 2081402729 1.94GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 17 1 0 FROZEN 1766208398043377000 2025-12-20 13:26:38.043377 1766294797559821004 2025-12-21 13:26:37.559821 1766294797559821005 1766294798043377000 2025-12-21 13:26:38.043377 1 1 none 2047613234 1.91GB 2047613234 1.91GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 18 1 0 FROZEN 1766294798043377000 2025-12-21 13:26:38.043377 1766381197587443006 2025-12-22 13:26:37.587443 1766381198042297000 1766381198043377000 2025-12-22 13:26:38.043377 1 1 none 2316788170 2.16GB 2316788170 2.16GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 19 1 0 FROZEN 1766381198043377000 2025-12-22 13:26:38.043377 1766467597596074004 2025-12-23 13:26:37.596074 1766467597596074005 1766467598043377000 2025-12-23 13:26:38.043377 1 1 none 2158548845 2.01GB 2158548845 2.01GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 20 1 0 FROZEN 1766467598043377000 2025-12-23 13:26:38.043377 1766553997793100002 2025-12-24 13:26:37.793100 1766553997793100002 1766553998043377000 2025-12-24 13:26:38.043377 1 1 none 2111969778 1.97GB 2111969778 1.97GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn
1002 2 21 1 0 ACTIVE 1766553998043377000 2025-12-24 13:26:38.043377 1766632244139984002 2025-12-25 11:10:44.139984 1766632270661420004 1766640398043377000 2025-12-25 13:26:38.043377 1 1 none 2272014663 2.12GB 2272014663 2.12GB 1.00 AVAILABLE s3://afarsoft/backup/archive?host=http://eos-zhengzhou-1-internal.cmecloud.cn 
  SELECT * FROM oceanbase.DBA_OB_BACKUP_DELETE_JOBS;

查询结果为空

SELECT * from oceanbase.dba_OB_BACKUP_SET_FILES;
1 1003 1 FULL 0 0 2025-12-05 13:42:34.075198 2025-12-05 13:47:08.288486 SUCCESS DELETED 274 OFF 1764912398043377000 2025-12-05 13:26:38.043377 1764913603377997000 2025-12-05 13:46:43.377997000 33908837620 3189103668 11630011.4092 0 10991 10991 16158 16158 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1764913463395691000 1 1
2 1003 1 FULL 0 0 2025-12-16 13:16:20.982910 2025-12-16 13:22:12.975220 SUCCESS AVAILABLE 352 OFF 1765855483120365002 2025-12-16 11:24:43.120365 1765862507073976000 2025-12-16 13:21:47.073976000 34131239768 3152667607 8956637.7373 0 11001 11001 16348 16264 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1765862353808355000 1 1
3 1003 1 FULL 0 0 2025-12-19 15:31:15.088662 2025-12-19 15:39:58.523662 SUCCESS AVAILABLE 523 ON 1766107070114450002 2025-12-19 09:17:50.114450 1766129833510897000 2025-12-19 15:37:13.510897000 34326331852 3269335933 6245925.3451 0 11012 11012 16357 16357 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1766129664310732000 1 1
4 1003 1 INC 3 3 2025-12-22 15:30:03.372317 2025-12-22 15:36:03.574348 SUCCESS AVAILABLE 360 OFF 1766368174263679000 2025-12-22 09:49:34.263679 1766388938552133000 2025-12-22 15:35:38.552133000 34124954335 782036717 2171105.7953 0 11012 11012 16273 16261 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1766388774045569000 1 1
5 1003 1 FULL 0 0 2025-12-23 15:36:32.506502 2025-12-23 15:44:17.474777 SUCCESS AVAILABLE 465 ON 1766448776769199002 2025-12-23 08:12:56.769199 1766475722933034000 2025-12-23 15:42:02.933034000 34515183785 3183436318 6846566.7211 0 11012 11012 16447 16447 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1766475572146862000 1 1
6 1003 1 FULL 0 0 2025-12-25 09:46:42.518643 2025-12-25 09:53:57.375345 SUCCESS AVAILABLE 435 ON 1766607029647016002 2025-12-25 04:10:29.647016 1766627534456409000 2025-12-25 09:52:14.456409000 33871065688 3213324260 7389386.5386 0 11012 11012 16140 16140 0 1 0 0 NONE 4.3.5.3 4 s3://afarsoft/backup/data?host=http://eos-zhengzhou-1-internal.cmecloud.cn 4.3.5.3 1766627371213029000 1 1

image
image1333×817 20 KB

image
image716×469 7.68 KB

1 个赞
#4

12.5～12.15号的归档piece 你点进去看下，是全部文件都没有清理 还是遗留了部分文件没有清理？

1 个赞
#5

另外你备份配置是在OCP配置的吗？

1 个赞
#6

这个看下

select * from CDB_OB_BACKUP_DELETE_JOB_HISTORY where tenant_id=xxx order by start_timestamp desc limit 5;
1 个赞
#7

select * from CDB_OB_BACKUP_DELETE_JOB_HISTORY where tenant_id=1002 order by start_timestamp desc limit 5;

1002 506 1 1002 506 1002 DELETE OBSOLETE BACKUP 2025-12-19 09:10:34.201877 USER_TENANT 2025-12-26 09:10:34.208934 2025-12-26 09:10:34.263490 COMPLETED 0 0 0
1002 505 1 1002 505 1002 DELETE OBSOLETE BACKUP 2025-12-19 08:10:33.954606 USER_TENANT 2025-12-26 08:10:33.962872 2025-12-26 08:10:34.022727 COMPLETED 0 0 0
1002 504 1 1002 504 1002 DELETE OBSOLETE BACKUP 2025-12-19 07:10:33.720633 USER_TENANT 2025-12-26 07:10:33.723989 2025-12-26 07:10:33.775383 COMPLETED 0 0 0
1002 503 1 1002 503 1002 DELETE OBSOLETE BACKUP 2025-12-19 06:10:33.479800 USER_TENANT 2025-12-26 06:10:33.487554 2025-12-26 06:10:33.545580 COMPLETED 0 0 0
1002 502 1 1002 502 1002 DELETE OBSOLETE BACKUP 2025-12-19 05:10:33.256958 USER_TENANT 2025-12-26 05:10:33.259142 2025-12-26 05:10:33.309128 COMPLETED 0 0 0

12.5～12.15号的归档piece 你点进去看下，是全部文件都没有清理 还是遗留了部分文件没有清理？

除了piece_d1001r1p1看着有点残其余的看着是完整的。

话说这个DBA_OB_ARCHIVELOG_PIECE_FILES这个视图有个地方想吐槽，所有行的Path字段都相同，难道不是应该指向具体的piece文件夹么，不然视图的piece怎么和文件夹对应上。大多数的情况下这个路径不会改。，出一个所有行都相同的列作用是什么

另外你备份配置是在OCP配置的吗？

没有使用OCP，OBD搭建的单节点集群

1 个赞
#8

是不是piece_d1002r2p1～piece_d1002r2p11 已经删除了？
piece_d1001r1p1是1001租户的

image
image2108×1220 133 KB

1 个赞
#9

看不大明白问题

#10

对。1-11确实没有了。从DBA_OB_ARCHIVELOG_PIECE_FILES前几个的FILE_STATUS上也能看得出来。

但是我的问题是为什么保留了这么多，明明设置保留7天。

#11

设置保留7天，备份保留到了12.16号，归档同样也要留到12.16号

#12

没看明白，备份清理策略为7天，难道他的含义不是仅保留最近7天的备份数据麽，超过这个时间点备份和归档删除？拿今天来说，难道不是19号之前的备份和归档文件夹都应该自动被删掉么。 现在怎么16号的备份和归档都还在

#13

对，这个7天是指 保证数据库可恢复到7天内的任意时间点，不是指备份文件保留7天，所以 昨天是25号，要保证数据可以恢复到18号，那么依据你的备份策略，16号的数据就不能删除。

#15

image
image1200×997 44.1 KB

P12是16号
P13是17号
……

还在删除中？ 不可能吧，这么多天还没删除，而且如果是删除中的话按照视图文档是会表现出来【删除中】的状态。

不过我好像理解你说的16号备份不能删除的原因了。因为要恢复到18号，离18号最近的全备是16号，所以备份和归档就能删除。 是这个意思么，在假设我17号有个全备，这种情况下16号的备份和归档就要被删掉了，理解的对么

image
image1127×977 213 KB

1 个赞
#16

对，这样理解是对的，你明天再观察下吧，16号的备份以及16～18号的归档应该就删除掉了

1 个赞
#17

学习了