租户在没有写数据的情况下，增备数据和全备数据大小基本一致

AntTech_6KTZWE · 2024 年11 月 13 日 11:20

【使用环境】生产环境
【 OB or 其他组件】OB
【使用版本】4.3.3.0
【问题描述】租户在没有写数据的情况下，增备数据和全备数据大小基本一致，这是正常的吗？

【复现路径】
做一次全备，然后，做增备，查看备份数据的大小，发现备份数据的大小基本一致
【附件及日志】

# du -sh *
127M    backup_set_32_full
127M    backup_set_33_inc
127M    backup_set_34_inc

每个备份集中的文件大小都是一样的，这里列举了部分文件的大小：

# du -sh backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/*
0       backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/index_tree.0.obbak
104M    backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
8.0K    backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_index.obbak
8.0K    backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/meta_index.obbak
0       backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/meta_tree.0.obbak


# du -sh backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/*
0       backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/index_tree.0.obbak
104M    backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
8.0K    backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_index.obbak
8.0K    backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/meta_index.obbak
0       backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/meta_tree.0.obbak


# du -sh backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/*
0       backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/index_tree.0.obbak
104M    backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
8.0K    backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_index.obbak
8.0K    backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/meta_index.obbak
0       backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/meta_tree.0.obbak

另外，对比了备份集中最大文件的MD5，发现MD5不同：

9a51d16f37db872fa255892cb8364d4d  backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
a06d4d5d974d5845c0f8773abb091592  backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
f9bc337c08735cda8396138f4f32999e  backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak

使用cmp命令两两比较三个最大文件的内容，发现都是在第108503051个字节时出现了不同，三个备份集中最大文件的大小都是108555437，也就是说这三个最大文件的大部分内容是一样的。

# ll backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
-rw------- 1 root root 108555437 Nov 12 06:38 backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak

# ll backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
-rw------- 1 root root 108555437 Nov 12 06:41 backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak

# ll backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
-rw------- 1 root root 108555437 Nov 12 06:46 backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak

backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
differ: char 108503051, line 385310

backup_set_34_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
differ: char 108503051, line 385310

backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak
differ: char 108503051, line 385310

旭辉 · 2024 年11 月 13 日 14:16

麻烦在1001租户root登陆查下

SELECT * FROM oceanbase.DBA_OB_BACKUP_JOB_HISTORY\G;

SELECT * FROM oceanbase.DBA_OB_BACKUP_TASK_HISTORY\G;

SELECT * FROM oceanbase.DBA_OB_BACKUP_SET_FILES\G;

另外灌入几百M的数据后再次做全量备份以及增量备份观察下大小是否一致

AntTech_6KTZWE · 2024 年11 月 13 日 15:29

执行上面的sql后，结果较多，所以放入了文件中：
sql.txt (62.6 KB)
灌入大概400M的数据后，执行一次全量备份和两次增量备份，备份文件大小如下：
740M backup_set_39_full
580M backup_set_40_inc
580M backup_set_41_inc
在全备和增备之间，以及两次增备之间都未写入数据。

另外，有个环境全备数据229G，增备数据228G，同样的是租户未写入任何数据，如果多做几次增备的话，磁盘消耗就太大了，很容易就爆了。

旭辉 · 2024 年11 月 13 日 16:03

是黑屏做的全量备份和增量备份还是在OCP做的呢？

AntTech_6KTZWE · 2024 年11 月 13 日 16:07

都做了，结果是一样的。

AntTech_6KTZWE · 2024 年11 月 13 日 16:23

用ob_admin查看了两个备份集中最大文件的内容，即：backup_set_32_full/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak和
backup_set_33_inc/logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak，
发现内容基本一致，只有文件后面的三个header_checksum的值不同，以及三个data_checksum的值不同。

旭辉 · 2024 年11 月 13 日 17:07

从这个数据看全量和第1次增量是有明显差异的，
第2次增量和第1次增量没有差异 --这个问题我再看下

“有个环境全备数据229G，增备数据228G，同样的是租户未写入任何数据” --这里未写入任何数据，有update或者delete操作吗？

AntTech_6KTZWE · 2024 年11 月 13 日 17:24

1、租户未写入任何数据是没有做insert、update、delete等与写数据相关的操作；
2、全备之后未做insert/update/delete相关的操作，后面第一次的增备为什么还是这么大呢？

旭辉 · 2024 年11 月 13 日 18:19

在分析中

旭辉 · 2024 年11 月 14 日 11:34

1.进入到backup_set_41_inc或者backup_set_40_inc，然后执行 tree -lhsD，如果现象如下则说明大头在sys数据，这些是日志流级别事务数据表和事务状态表的数据，是不能重用的，因此不会变化

2.标准的备份流程：
a. 触发合并等待合并完成
b. 发起全备
c. 发起增备
d. 发起增备
……

你按照这个流程备份下229G那个租户，正常情况下增量会和全备份差别较大，增量之间也会差异较大

如果有问题你继续反馈到这里

AntTech_6KTZWE · 2024 年11 月 14 日 13:22

1、下面是229G环境的增备，大头在logstream_1001/user_data_turn_1_retry_0/macro_block_data*.obbak

[root@poc-ocp-ob-node-01 backup_set_8_inc]# tree -lhsD
.
├── [ 54 Nov 13 10:28] backup_set_8_inc_20241113T101200_20241113T102745.obbak
├── [ 4.0K Nov 13 10:28] infos
│ ├── [ 453 Nov 13 10:28] diagnose_info.obbak
│ ├── [ 221 Nov 13 10:28] locality_info.obbak
│ ├── [ 4.0K Nov 13 10:27] major_data_info_turn_1
│ │ ├── [ 1.9M Nov 13 10:27] tenant_major_data_macro_block_index.0.obbak
│ │ └── [ 104K Nov 13 10:27] tenant_major_data_meta_index.0.obbak
│ ├── [ 4.0K Nov 13 10:12] meta_info
│ │ ├── [ 125 Nov 13 10:12] ls_attr_info.1.obbak
│ │ └── [ 745 Nov 13 10:12] ls_meta_infos.obbak
│ ├── [ 4.0K Nov 13 10:27] table_list
│ │ ├── [ 3.0K Nov 13 10:27] table_list.1731464865141072000.1.obbak
│ │ └── [ 118 Nov 13 10:27] table_list_meta_info.1731464865141072000.obbak
│ └── [ 4.0K Nov 13 10:12] user_data_info_turn_1
│ └── [ 105K Nov 13 10:12] tablet_log_stream_info.obbak
├── [ 4.0K Nov 13 10:27] logstream_1
│ ├── [ 4.0K Nov 13 10:27] fused_meta_info_turn_1_retry_0
│ │ └── [ 2.7M Nov 13 10:27] tablet_info.1.obbak
│ ├── [ 4.0K Nov 13 10:12] meta_info_turn_1_retry_0
│ │ ├── [ 400 Nov 13 10:12] ls_meta_info.obbak
│ │ └── [ 2.7M Nov 13 10:12] tablet_info.1.obbak
│ ├── [ 4.0K Nov 13 10:12] sys_data_turn_1_retry_0
│ │ ├── [ 2.0M Nov 13 10:12] index_tree.0.obbak
│ │ ├── [ 598M Nov 13 10:12] macro_block_data.0.obbak
│ │ ├── [ 8.1K Nov 13 10:12] macro_block_index.obbak
│ │ ├── [ 4.3K Nov 13 10:12] meta_index.obbak
│ │ └── [ 2.0M Nov 13 10:12] meta_tree.0.obbak
│ └── [ 4.0K Nov 13 10:12] user_data_turn_1_retry_0
│ ├── [ 0 Nov 13 10:12] index_tree.0.obbak
│ ├── [ 93M Nov 13 10:12] macro_block_data.0.obbak
│ ├── [ 5.5K Nov 13 10:12] macro_block_index.obbak
│ ├── [ 8.9K Nov 13 10:12] meta_index.obbak
│ └── [ 0 Nov 13 10:12] meta_tree.0.obbak
├── [ 4.0K Nov 13 10:27] logstream_1001
│ ├── [ 4.0K Nov 13 10:28] fused_meta_info_turn_1_retry_0
│ │ └── [ 50M Nov 13 10:28] tablet_info.1.obbak
│ ├── [ 4.0K Nov 13 10:12] meta_info_turn_1_retry_0
│ │ ├── [ 398 Nov 13 10:12] ls_meta_info.obbak
│ │ └── [ 50M Nov 13 10:12] tablet_info.1.obbak
│ ├── [ 4.0K Nov 13 10:12] sys_data_turn_1_retry_0
│ │ ├── [ 0 Nov 13 10:12] index_tree.0.obbak
│ │ ├── [ 97K Nov 13 10:12] macro_block_data.0.obbak
│ │ ├── [ 4.3K Nov 13 10:12] macro_block_index.obbak
│ │ ├── [ 4.3K Nov 13 10:12] meta_index.obbak
│ │ └── [ 0 Nov 13 10:12] meta_tree.0.obbak
│ └── [ 28K Nov 13 10:27] user_data_turn_1_retry_0
│ ├── [ 4.0M Nov 13 10:12] index_tree.0.obbak
│ ├── [ 0 Nov 13 10:27] index_tree.100.obbak
│ ├── [ 6.0M Nov 13 10:14] index_tree.10.obbak
│ ├── [ 6.0M Nov 13 10:15] index_tree.11.obbak
│ ├── [ 8.0M Nov 13 10:15] index_tree.12.obbak
│ ├── [ 2.0M Nov 13 10:15] index_tree.13.obbak
│ ├── [ 6.0M Nov 13 10:15] index_tree.14.obbak
│ ├── [ 2.0M Nov 13 10:15] index_tree.15.obbak
│ ├── [ 2.0M Nov 13 10:15] index_tree.16.obbak
│ ├── [ 0 Nov 13 10:15] index_tree.17.obbak
│ ├── [ 2.0M Nov 13 10:16] index_tree.18.obbak
│ ├── [ 2.0M Nov 13 10:16] index_tree.19.obbak
│ ├── [ 2.0M Nov 13 10:12] index_tree.1.obbak
│ ├── [ 4.0M Nov 13 10:16] index_tree.20.obbak
│ ├── [ 8.0M Nov 13 10:16] index_tree.21.obbak
│ ├── [ 16M Nov 13 10:16] index_tree.22.obbak
│ ├── [ 10M Nov 13 10:17] index_tree.23.obbak
│ ├── [ 8.0M Nov 13 10:17] index_tree.24.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.25.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.26.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.27.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.28.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.29.obbak
│ ├── [ 2.0M Nov 13 10:13] index_tree.2.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.30.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.31.obbak
│ ├── [ 0 Nov 13 10:17] index_tree.32.obbak
│ ├── [ 0 Nov 13 10:18] index_tree.33.obbak
│ ├── [ 2.0M Nov 13 10:18] index_tree.34.obbak
│ ├── [ 4.0M Nov 13 10:18] index_tree.35.obbak
│ ├── [ 10M Nov 13 10:18] index_tree.36.obbak
│ ├── [ 14M Nov 13 10:18] index_tree.37.obbak
│ ├── [ 0 Nov 13 10:18] index_tree.38.obbak
│ ├── [ 0 Nov 13 10:18] index_tree.39.obbak
│ ├── [ 2.0M Nov 13 10:13] index_tree.3.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.40.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.41.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.42.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.43.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.44.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.45.obbak
│ ├── [ 0 Nov 13 10:19] index_tree.46.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.47.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.48.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.49.obbak
│ ├── [ 8.0M Nov 13 10:13] index_tree.4.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.50.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.51.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.52.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.53.obbak
│ ├── [ 0 Nov 13 10:20] index_tree.54.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.55.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.56.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.57.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.58.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.59.obbak
│ ├── [ 4.0M Nov 13 10:13] index_tree.5.obbak
│ ├── [ 0 Nov 13 10:21] index_tree.60.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.61.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.62.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.63.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.64.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.65.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.66.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.67.obbak
│ ├── [ 0 Nov 13 10:22] index_tree.68.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.69.obbak
│ ├── [ 4.0M Nov 13 10:13] index_tree.6.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.70.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.71.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.72.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.73.obbak
│ ├── [ 0 Nov 13 10:23] index_tree.74.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.75.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.76.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.77.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.78.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.79.obbak
│ ├── [ 2.0M Nov 13 10:14] index_tree.7.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.80.obbak
│ ├── [ 0 Nov 13 10:24] index_tree.81.obbak
│ ├── [ 0 Nov 13 10:25] index_tree.82.obbak
│ ├── [ 0 Nov 13 10:25] index_tree.83.obbak
│ ├── [ 0 Nov 13 10:25] index_tree.84.obbak
│ ├── [ 0 Nov 13 10:25] index_tree.85.obbak
│ ├── [ 2.0M Nov 13 10:25] index_tree.86.obbak
│ ├── [ 2.0M Nov 13 10:26] index_tree.87.obbak
│ ├── [ 4.0M Nov 13 10:26] index_tree.88.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.89.obbak
│ ├── [ 2.0M Nov 13 10:14] index_tree.8.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.90.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.91.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.92.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.93.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.94.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.95.obbak
│ ├── [ 0 Nov 13 10:26] index_tree.96.obbak
│ ├── [ 0 Nov 13 10:27] index_tree.97.obbak
│ ├── [ 0 Nov 13 10:27] index_tree.98.obbak
│ ├── [ 0 Nov 13 10:27] index_tree.99.obbak
│ ├── [ 0 Nov 13 10:14] index_tree.9.obbak
│ ├── [ 2.9G Nov 13 10:12] macro_block_data.0.obbak
│ ├── [ 681M Nov 13 10:27] macro_block_data.100.obbak
│ ├── [ 3.3G Nov 13 10:14] macro_block_data.10.obbak
│ ├── [ 3.3G Nov 13 10:15] macro_block_data.11.obbak
│ ├── [ 3.2G Nov 13 10:15] macro_block_data.12.obbak
│ ├── [ 3.2G Nov 13 10:15] macro_block_data.13.obbak
│ ├── [ 3.3G Nov 13 10:15] macro_block_data.14.obbak
│ ├── [ 1.5G Nov 13 10:15] macro_block_data.15.obbak
│ ├── [ 29M Nov 13 10:15] macro_block_data.16.obbak
│ ├── [ 76M Nov 13 10:15] macro_block_data.17.obbak
│ ├── [ 3.1G Nov 13 10:16] macro_block_data.18.obbak
│ ├── [ 3.0G Nov 13 10:16] macro_block_data.19.obbak
│ ├── [ 2.8G Nov 13 10:12] macro_block_data.1.obbak
│ ├── [ 3.1G Nov 13 10:16] macro_block_data.20.obbak
│ ├── [ 3.0G Nov 13 10:16] macro_block_data.21.obbak
│ ├── [ 2.9G Nov 13 10:16] macro_block_data.22.obbak
│ ├── [ 3.7G Nov 13 10:17] macro_block_data.23.obbak
│ ├── [ 2.3G Nov 13 10:17] macro_block_data.24.obbak
│ ├── [ 712M Nov 13 10:17] macro_block_data.25.obbak
│ ├── [ 1.9G Nov 13 10:17] macro_block_data.26.obbak
│ ├── [ 1.8G Nov 13 10:17] macro_block_data.27.obbak
│ ├── [ 1.6G Nov 13 10:17] macro_block_data.28.obbak
│ ├── [ 1.9G Nov 13 10:17] macro_block_data.29.obbak
│ ├── [ 2.9G Nov 13 10:13] macro_block_data.2.obbak
│ ├── [ 1.7G Nov 13 10:17] macro_block_data.30.obbak
│ ├── [ 1.8G Nov 13 10:17] macro_block_data.31.obbak
│ ├── [ 1.8G Nov 13 10:18] macro_block_data.32.obbak
│ ├── [ 1.8G Nov 13 10:18] macro_block_data.33.obbak
│ ├── [ 2.1G Nov 13 10:18] macro_block_data.34.obbak
│ ├── [ 3.7G Nov 13 10:18] macro_block_data.35.obbak
│ ├── [ 3.6G Nov 13 10:18] macro_block_data.36.obbak
│ ├── [ 3.2G Nov 13 10:18] macro_block_data.37.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.38.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.39.obbak
│ ├── [ 2.8G Nov 13 10:13] macro_block_data.3.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.40.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.41.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.42.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.43.obbak
│ ├── [ 2.0G Nov 13 10:19] macro_block_data.44.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.45.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.46.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.47.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.48.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.49.obbak
│ ├── [ 3.3G Nov 13 10:13] macro_block_data.4.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.50.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.51.obbak
│ ├── [ 2.0G Nov 13 10:20] macro_block_data.52.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.53.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.54.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.55.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.56.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.57.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.58.obbak
│ ├── [ 2.0G Nov 13 10:21] macro_block_data.59.obbak
│ ├── [ 3.1G Nov 13 10:13] macro_block_data.5.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.60.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.61.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.62.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.63.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.64.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.65.obbak
│ ├── [ 2.0G Nov 13 10:22] macro_block_data.66.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.67.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.68.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.69.obbak
│ ├── [ 3.1G Nov 13 10:13] macro_block_data.6.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.70.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.71.obbak
│ ├── [ 2.0G Nov 13 10:23] macro_block_data.72.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.73.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.74.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.75.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.76.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.77.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.78.obbak
│ ├── [ 2.0G Nov 13 10:24] macro_block_data.79.obbak
│ ├── [ 3.3G Nov 13 10:14] macro_block_data.7.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.80.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.81.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.82.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.83.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.84.obbak
│ ├── [ 2.0G Nov 13 10:25] macro_block_data.85.obbak
│ ├── [ 2.2G Nov 13 10:25] macro_block_data.86.obbak
│ ├── [ 3.4G Nov 13 10:26] macro_block_data.87.obbak
│ ├── [ 3.1G Nov 13 10:26] macro_block_data.88.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.89.obbak
│ ├── [ 3.2G Nov 13 10:14] macro_block_data.8.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.90.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.91.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.92.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.93.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.94.obbak
│ ├── [ 2.1G Nov 13 10:26] macro_block_data.95.obbak
│ ├── [ 2.1G Nov 13 10:27] macro_block_data.96.obbak
│ ├── [ 2.1G Nov 13 10:27] macro_block_data.97.obbak
│ ├── [ 2.1G Nov 13 10:27] macro_block_data.98.obbak
│ ├── [ 2.1G Nov 13 10:27] macro_block_data.99.obbak
│ ├── [ 3.3G Nov 13 10:14] macro_block_data.9.obbak
│ ├── [ 1.3M Nov 13 10:27] macro_block_index.obbak
│ ├── [ 99K Nov 13 10:27] meta_index.obbak
│ ├── [ 4.0M Nov 13 10:12] meta_tree.0.obbak
│ ├── [ 0 Nov 13 10:27] meta_tree.100.obbak
│ ├── [ 2.0M Nov 13 10:14] meta_tree.10.obbak
│ ├── [ 6.0M Nov 13 10:15] meta_tree.11.obbak
│ ├── [ 2.0M Nov 13 10:15] meta_tree.12.obbak
│ ├── [ 0 Nov 13 10:15] meta_tree.13.obbak
│ ├── [ 2.0M Nov 13 10:15] meta_tree.14.obbak
│ ├── [ 0 Nov 13 10:15] meta_tree.15.obbak
│ ├── [ 0 Nov 13 10:15] meta_tree.16.obbak
│ ├── [ 0 Nov 13 10:15] meta_tree.17.obbak
│ ├── [ 2.0M Nov 13 10:16] meta_tree.18.obbak
│ ├── [ 2.0M Nov 13 10:16] meta_tree.19.obbak
│ ├── [ 2.0M Nov 13 10:12] meta_tree.1.obbak
│ ├── [ 4.0M Nov 13 10:16] meta_tree.20.obbak
│ ├── [ 8.0M Nov 13 10:16] meta_tree.21.obbak
│ ├── [ 8.0M Nov 13 10:16] meta_tree.22.obbak
│ ├── [ 10M Nov 13 10:17] meta_tree.23.obbak
│ ├── [ 4.0M Nov 13 10:17] meta_tree.24.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.25.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.26.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.27.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.28.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.29.obbak
│ ├── [ 2.0M Nov 13 10:13] meta_tree.2.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.30.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.31.obbak
│ ├── [ 0 Nov 13 10:17] meta_tree.32.obbak
│ ├── [ 0 Nov 13 10:18] meta_tree.33.obbak
│ ├── [ 2.0M Nov 13 10:18] meta_tree.34.obbak
│ ├── [ 4.0M Nov 13 10:18] meta_tree.35.obbak
│ ├── [ 4.0M Nov 13 10:18] meta_tree.36.obbak
│ ├── [ 10M Nov 13 10:18] meta_tree.37.obbak
│ ├── [ 0 Nov 13 10:18] meta_tree.38.obbak
│ ├── [ 0 Nov 13 10:18] meta_tree.39.obbak
│ ├── [ 2.0M Nov 13 10:13] meta_tree.3.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.40.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.41.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.42.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.43.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.44.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.45.obbak
│ ├── [ 0 Nov 13 10:19] meta_tree.46.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.47.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.48.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.49.obbak
│ ├── [ 8.0M Nov 13 10:13] meta_tree.4.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.50.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.51.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.52.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.53.obbak
│ ├── [ 0 Nov 13 10:20] meta_tree.54.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.55.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.56.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.57.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.58.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.59.obbak
│ ├── [ 4.0M Nov 13 10:13] meta_tree.5.obbak
│ ├── [ 0 Nov 13 10:21] meta_tree.60.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.61.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.62.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.63.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.64.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.65.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.66.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.67.obbak
│ ├── [ 0 Nov 13 10:22] meta_tree.68.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.69.obbak
│ ├── [ 6.0M Nov 13 10:13] meta_tree.6.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.70.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.71.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.72.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.73.obbak
│ ├── [ 0 Nov 13 10:23] meta_tree.74.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.75.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.76.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.77.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.78.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.79.obbak
│ ├── [ 0 Nov 13 10:13] meta_tree.7.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.80.obbak
│ ├── [ 0 Nov 13 10:24] meta_tree.81.obbak
│ ├── [ 0 Nov 13 10:25] meta_tree.82.obbak
│ ├── [ 0 Nov 13 10:25] meta_tree.83.obbak
│ ├── [ 0 Nov 13 10:25] meta_tree.84.obbak
│ ├── [ 0 Nov 13 10:25] meta_tree.85.obbak
│ ├── [ 2.0M Nov 13 10:25] meta_tree.86.obbak
│ ├── [ 2.0M Nov 13 10:26] meta_tree.87.obbak
│ ├── [ 4.0M Nov 13 10:26] meta_tree.88.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.89.obbak
│ ├── [ 2.0M Nov 13 10:14] meta_tree.8.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.90.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.91.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.92.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.93.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.94.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.95.obbak
│ ├── [ 0 Nov 13 10:26] meta_tree.96.obbak
│ ├── [ 0 Nov 13 10:27] meta_tree.97.obbak
│ ├── [ 0 Nov 13 10:27] meta_tree.98.obbak
│ ├── [ 0 Nov 13 10:27] meta_tree.99.obbak
│ └── [ 4.0M Nov 13 10:14] meta_tree.9.obbak
├── [ 278 Nov 13 10:28] single_backup_set_info.obbak
└── [ 1.7K Nov 13 10:28] tenant_backup_set_infos.obbak

2、上面是使用的OCP做的备份，也需要在备份前做触发合并等待合并完成吗？

旭辉 · 2024 年11 月 14 日 13:44

“上面是使用的OCP做的备份，也需要在备份前做触发合并等待合并完成吗？”

–是的，需要的，麻烦按照这个步骤重新备份，对比下全备份和增备份以及增备份和增备份之间的备份大小

AntTech_6KTZWE · 2024 年11 月 14 日 14:40

这里是用测试环境做的备份，229G的环境是生成环境，现在还不能测试。

按照下面的备份流程做了备份：
a. 触发合并等待合并完成
b. 发起全备
c. 发起增备
d. 发起增备

备份数据大小相差不大，数据大头虽然在sys数据，但是
logstream_1001/user_data_turn_1_retry_0/macro_block_data.0.obbak的大小：
全备中：178M
第一次增备中：166M
第二次增备中：166M
在全备和增备中相差不大，增备和增备中该文件的大小完全一样。

838M    backup_set_54_full
826M    backup_set_55_inc
826M    backup_set_56_inc

触发合并，等待合并完成用的sql是：
sys租户登录并执行：
ALTER SYSTEM MAJOR FREEZE TENANT = all;
查看合并是否完成：
SELECT * FROM oceanbase.CDB_OB_ZONE_MAJOR_COMPACTION;

[root@test backup_set_54_full]# tree -lhsD
.
|-- [  54 Nov 14  5:50]  backup_set_54_full_20241114T054859_20241114T055020.obbak
|-- [ 182 Nov 14  5:50]  infos
|   |-- [ 332 Nov 14  5:50]  diagnose_info.obbak
|   |-- [ 164 Nov 14  5:50]  locality_info.obbak
|   |-- [ 113 Nov 14  5:50]  major_data_info_turn_1
|   |   |-- [5.4K Nov 14  5:50]  tenant_major_data_macro_block_index.0.obbak
|   |   `-- [8.9K Nov 14  5:50]  tenant_major_data_meta_index.0.obbak
|   |-- [  73 Nov 14  5:49]  meta_info
|   |   |-- [ 125 Nov 14  5:49]  ls_attr_info.1.obbak
|   |   `-- [ 738 Nov 14  5:49]  ls_meta_infos.obbak
|   |-- [ 118 Nov 14  5:50]  table_list
|   |   |-- [ 143 Nov 14  5:50]  table_list.1731563420048591000.1.obbak
|   |   `-- [ 118 Nov 14  5:50]  table_list_meta_info.1731563420048591000.obbak
|   `-- [  50 Nov 14  5:49]  user_data_info_turn_1
|       `-- [5.5K Nov 14  5:49]  tablet_log_stream_info.obbak
|-- [ 159 Nov 14  5:50]  logstream_1
|   |-- [  41 Nov 14  5:50]  fused_meta_info_turn_1_retry_0
|   |   `-- [2.7M Nov 14  5:50]  tablet_info.1.obbak
|   |-- [  71 Nov 14  5:49]  meta_info_turn_1_retry_0
|   |   |-- [ 400 Nov 14  5:49]  ls_meta_info.obbak
|   |   `-- [2.7M Nov 14  5:49]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:49]  sys_data_turn_1_retry_0
|   |   |-- [   0 Nov 14  5:49]  index_tree.0.obbak
|   |   |-- [576K Nov 14  5:49]  macro_block_data.0.obbak
|   |   |-- [4.3K Nov 14  5:49]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:49]  meta_index.obbak
|   |   `-- [   0 Nov 14  5:49]  meta_tree.0.obbak
|   `-- [ 168 Nov 14  5:49]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:49]  index_tree.0.obbak
|       |-- [ 12M Nov 14  5:49]  macro_block_data.0.obbak
|       |-- [4.8K Nov 14  5:49]  macro_block_index.obbak
|       |-- [8.8K Nov 14  5:49]  meta_index.obbak
|       `-- [   0 Nov 14  5:49]  meta_tree.0.obbak
|-- [ 159 Nov 14  5:50]  logstream_1001
|   |-- [  33 Nov 14  5:50]  fused_meta_info_turn_1_retry_0
|   |   `-- [ 28K Nov 14  5:50]  tablet_info.1.obbak
|   |-- [  59 Nov 14  5:49]  meta_info_turn_1_retry_0
|   |   |-- [ 391 Nov 14  5:49]  ls_meta_info.obbak
|   |   `-- [ 28K Nov 14  5:49]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:49]  sys_data_turn_1_retry_0
|   |   |-- [2.0M Nov 14  5:49]  index_tree.0.obbak
|   |   |-- [638M Nov 14  5:49]  macro_block_data.0.obbak
|   |   |-- [5.9K Nov 14  5:49]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:49]  meta_index.obbak
|   |   `-- [2.0M Nov 14  5:49]  meta_tree.0.obbak
|   `-- [ 144 Nov 14  5:50]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:49]  index_tree.0.obbak
|       |-- [178M Nov 14  5:49]  macro_block_data.0.obbak
|       |-- [5.0K Nov 14  5:50]  macro_block_index.obbak
|       |-- [4.3K Nov 14  5:50]  meta_index.obbak
|       `-- [   0 Nov 14  5:49]  meta_tree.0.obbak
|-- [ 214 Nov 14  5:50]  single_backup_set_info.obbak
`-- [8.1K Nov 14  5:50]  tenant_backup_set_infos.obbak



[root@test backup_set_55_inc]# tree -lhsD
.
|-- [  54 Nov 14  5:56]  backup_set_55_inc_20241114T055452_20241114T055604.obbak
|-- [ 182 Nov 14  5:56]  infos
|   |-- [ 332 Nov 14  5:56]  diagnose_info.obbak
|   |-- [ 164 Nov 14  5:56]  locality_info.obbak
|   |-- [ 113 Nov 14  5:56]  major_data_info_turn_1
|   |   |-- [6.2K Nov 14  5:56]  tenant_major_data_macro_block_index.0.obbak
|   |   `-- [9.0K Nov 14  5:56]  tenant_major_data_meta_index.0.obbak
|   |-- [  73 Nov 14  5:55]  meta_info
|   |   |-- [ 125 Nov 14  5:55]  ls_attr_info.1.obbak
|   |   `-- [ 738 Nov 14  5:55]  ls_meta_infos.obbak
|   |-- [ 118 Nov 14  5:56]  table_list
|   |   |-- [ 143 Nov 14  5:56]  table_list.1731563764933258000.1.obbak
|   |   `-- [ 118 Nov 14  5:56]  table_list_meta_info.1731563764933258000.obbak
|   `-- [  50 Nov 14  5:55]  user_data_info_turn_1
|       `-- [5.5K Nov 14  5:55]  tablet_log_stream_info.obbak
|-- [ 159 Nov 14  5:56]  logstream_1
|   |-- [  41 Nov 14  5:56]  fused_meta_info_turn_1_retry_0
|   |   `-- [2.7M Nov 14  5:56]  tablet_info.1.obbak
|   |-- [  71 Nov 14  5:54]  meta_info_turn_1_retry_0
|   |   |-- [ 400 Nov 14  5:54]  ls_meta_info.obbak
|   |   `-- [2.7M Nov 14  5:54]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:54]  sys_data_turn_1_retry_0
|   |   |-- [   0 Nov 14  5:54]  index_tree.0.obbak
|   |   |-- [592K Nov 14  5:54]  macro_block_data.0.obbak
|   |   |-- [4.3K Nov 14  5:54]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:54]  meta_index.obbak
|   |   `-- [   0 Nov 14  5:54]  meta_tree.0.obbak
|   `-- [ 168 Nov 14  5:55]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:55]  index_tree.0.obbak
|       |-- [ 12M Nov 14  5:55]  macro_block_data.0.obbak
|       |-- [4.8K Nov 14  5:55]  macro_block_index.obbak
|       |-- [8.9K Nov 14  5:55]  meta_index.obbak
|       `-- [   0 Nov 14  5:55]  meta_tree.0.obbak
|-- [ 159 Nov 14  5:56]  logstream_1001
|   |-- [  33 Nov 14  5:56]  fused_meta_info_turn_1_retry_0
|   |   `-- [ 28K Nov 14  5:56]  tablet_info.1.obbak
|   |-- [  59 Nov 14  5:55]  meta_info_turn_1_retry_0
|   |   |-- [ 391 Nov 14  5:55]  ls_meta_info.obbak
|   |   `-- [ 28K Nov 14  5:55]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:55]  sys_data_turn_1_retry_0
|   |   |-- [2.0M Nov 14  5:55]  index_tree.0.obbak
|   |   |-- [638M Nov 14  5:55]  macro_block_data.0.obbak
|   |   |-- [5.9K Nov 14  5:55]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:55]  meta_index.obbak
|   |   `-- [2.0M Nov 14  5:55]  meta_tree.0.obbak
|   `-- [ 144 Nov 14  5:55]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:55]  index_tree.0.obbak
|       |-- [166M Nov 14  5:55]  macro_block_data.0.obbak
|       |-- [5.0K Nov 14  5:55]  macro_block_index.obbak
|       |-- [4.3K Nov 14  5:55]  meta_index.obbak
|       `-- [   0 Nov 14  5:55]  meta_tree.0.obbak
|-- [ 214 Nov 14  5:56]  single_backup_set_info.obbak
`-- [8.2K Nov 14  5:56]  tenant_backup_set_infos.obbak



[root@test backup_set_56_inc]# tree -lhsD
.
|-- [  54 Nov 14  5:58]  backup_set_56_inc_20241114T055707_20241114T055826.obbak
|-- [ 182 Nov 14  5:58]  infos
|   |-- [ 332 Nov 14  5:58]  diagnose_info.obbak
|   |-- [ 164 Nov 14  5:58]  locality_info.obbak
|   |-- [ 113 Nov 14  5:58]  major_data_info_turn_1
|   |   |-- [6.7K Nov 14  5:58]  tenant_major_data_macro_block_index.0.obbak
|   |   `-- [9.0K Nov 14  5:58]  tenant_major_data_meta_index.0.obbak
|   |-- [  73 Nov 14  5:57]  meta_info
|   |   |-- [ 125 Nov 14  5:57]  ls_attr_info.1.obbak
|   |   `-- [ 738 Nov 14  5:57]  ls_meta_infos.obbak
|   |-- [ 118 Nov 14  5:58]  table_list
|   |   |-- [ 143 Nov 14  5:58]  table_list.1731563906995319000.1.obbak
|   |   `-- [ 118 Nov 14  5:58]  table_list_meta_info.1731563906995319000.obbak
|   `-- [  50 Nov 14  5:57]  user_data_info_turn_1
|       `-- [5.5K Nov 14  5:57]  tablet_log_stream_info.obbak
|-- [ 159 Nov 14  5:58]  logstream_1
|   |-- [  41 Nov 14  5:58]  fused_meta_info_turn_1_retry_0
|   |   `-- [2.7M Nov 14  5:58]  tablet_info.1.obbak
|   |-- [  71 Nov 14  5:57]  meta_info_turn_1_retry_0
|   |   |-- [ 400 Nov 14  5:57]  ls_meta_info.obbak
|   |   `-- [2.7M Nov 14  5:57]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:57]  sys_data_turn_1_retry_0
|   |   |-- [   0 Nov 14  5:57]  index_tree.0.obbak
|   |   |-- [240K Nov 14  5:57]  macro_block_data.0.obbak
|   |   |-- [4.3K Nov 14  5:57]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:57]  meta_index.obbak
|   |   `-- [   0 Nov 14  5:57]  meta_tree.0.obbak
|   `-- [ 168 Nov 14  5:57]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:57]  index_tree.0.obbak
|       |-- [ 12M Nov 14  5:57]  macro_block_data.0.obbak
|       |-- [4.8K Nov 14  5:57]  macro_block_index.obbak
|       |-- [8.9K Nov 14  5:57]  meta_index.obbak
|       `-- [   0 Nov 14  5:57]  meta_tree.0.obbak
|-- [ 159 Nov 14  5:58]  logstream_1001
|   |-- [  33 Nov 14  5:58]  fused_meta_info_turn_1_retry_0
|   |   `-- [ 28K Nov 14  5:58]  tablet_info.1.obbak
|   |-- [  59 Nov 14  5:57]  meta_info_turn_1_retry_0
|   |   |-- [ 391 Nov 14  5:57]  ls_meta_info.obbak
|   |   `-- [ 28K Nov 14  5:57]  tablet_info.1.obbak
|   |-- [ 168 Nov 14  5:57]  sys_data_turn_1_retry_0
|   |   |-- [2.0M Nov 14  5:57]  index_tree.0.obbak
|   |   |-- [638M Nov 14  5:57]  macro_block_data.0.obbak
|   |   |-- [5.9K Nov 14  5:57]  macro_block_index.obbak
|   |   |-- [4.3K Nov 14  5:57]  meta_index.obbak
|   |   `-- [2.0M Nov 14  5:57]  meta_tree.0.obbak
|   `-- [ 144 Nov 14  5:58]  user_data_turn_1_retry_0
|       |-- [   0 Nov 14  5:58]  index_tree.0.obbak
|       |-- [166M Nov 14  5:58]  macro_block_data.0.obbak
|       |-- [5.0K Nov 14  5:58]  macro_block_index.obbak
|       |-- [4.3K Nov 14  5:58]  meta_index.obbak
|       `-- [   0 Nov 14  5:58]  meta_tree.0.obbak
|-- [ 214 Nov 14  5:58]  single_backup_set_info.obbak
`-- [8.4K Nov 14  5:58]  tenant_backup_set_infos.obbak

旭辉 · 2024 年11 月 14 日 15:16

麻烦确认几个问题：
1.是否建了一些空表，然后有导入数据的操作？
2.查下这个业务租户的tablet的个数
select count(*) from DBA_OB_TABLE_LOCATIONS; --业务租户下执行

select count(*) from __all_virtual_tablet_to_ls where tenant_id = 业务租户; --sys租户执行

3.查下业务租户的磁盘空间占用与数据量大小

select svr_ip, svr_port, tenant_id, sum(used_size)/1024/1024/1024 from __all_space_usage where tenant_id=业务租户 and file_type in (‘tenant file data’, ‘tenant meta data’, ‘tenant tmp data’) group by svr_ip, svr_port;

–sys租户执行

select sum(data_block_count) from __all_virtual_table_mgr where tenant_id = 业务租户 and ls_id <> 1 and tablet_id not in (49401, 49402, 49403);

–sys租户执行

select /*+
query_timeout(30000000) */ a.DATABASE_NAME, sum(IFNULL(b.size,
0))/1024/1024/1024,
sum(
case
when
b.nested_offset = 0 then
IFNULL(b.data_block_count+b.index_block_count+b.linked_block_count, 0) * 2 *
1024 * 1024
else
IFNULL(b.size, 0)
end
)
/1024.0/1024/1024 as data_size_in_GB
from
CDB_OB_TABLE_LOCATIONS a inner join __all_virtual_table_mgr b
on a.svr_ip =
b.svr_ip and a.svr_port=b.svr_port and a.tenant_id = b.tenant_id and a.LS_ID =
b.LS_ID and a.TABLET_ID = b.TABLET_ID
and a.role =
‘LEADER’ and a.tenant_id = 业务租户
and
b.table_type >= 10 and b.size > 0 group by a.DATABASE_NAME;

–sys租户执行

4.查下observer的具体版本
进入到安装路径的bin下

./observer -V

AntTech_6KTZWE · 2024 年11 月 14 日 15:42

1、业务租户下有一张空表，但是，没有导入数据的操作。

2、
业务租户执行：

MySQL [oceanbase]> select count(*) from DBA_OB_TABLE_LOCATIONS;
+----------+
| count(*) |
+----------+
|      691 |
+----------+
1 row in set (0.025 sec)

sys租户执行：

MySQL [oceanbase]> select count(*) from __all_virtual_tablet_to_ls where tenant_id = 1004;
+----------+
| count(*) |
+----------+
|        4 |
+----------+
1 row in set (0.003 sec)

3、
sys租户执行：

MySQL [oceanbase]> select svr_ip, svr_port, tenant_id, sum(used_size)/1024/1024/1024 from __all_space_usage where tenant_id=1004 and file_type in ('tenant file data',  'tenant meta data', 'tenant tmp data') group by svr_ip, svr_port;
+-------------+----------+-----------+-------------------------------+
| svr_ip      | svr_port | tenant_id | sum(used_size)/1024/1024/1024 |
+-------------+----------+-----------+-------------------------------+
| 172.30.0.51 |     2882 |      1004 |                0.885318756104 |
+-------------+----------+-----------+-------------------------------+
1 row in set (0.004 sec)

sys租户执行：

MySQL [oceanbase]> select sum(data_block_count) from __all_virtual_table_mgr where tenant_id = 1004 and ls_id <> 1 and tablet_id not in (49401, 49402, 49403);
+-----------------------+
| sum(data_block_count) |
+-----------------------+
|                    95 |
+-----------------------+
1 row in set (0.040 sec)

sys租户执行：

MySQL [oceanbase]> select /*+
   /*> query_timeout(30000000) */ a.DATABASE_NAME, sum(IFNULL(b.size,
    -> 0))/1024/1024/1024,
    -> sum(
    -> case
    -> when
    -> b.nested_offset = 0 then
    -> IFNULL(b.data_block_count+b.index_block_count+b.linked_block_count, 0) * 2 *
    -> 1024 * 1024
    -> else
    -> IFNULL(b.size, 0)
    -> end
    -> )
    -> /1024.0/1024/1024 as data_size_in_GB
    -> from
    -> CDB_OB_TABLE_LOCATIONS a inner join __all_virtual_table_mgr b
    -> on a.svr_ip =
    -> b.svr_ip and a.svr_port=b.svr_port and a.tenant_id = b.tenant_id and a.LS_ID =
    -> b.LS_ID and a.TABLET_ID = b.TABLET_ID
    -> and a.role =
    -> 'LEADER' and a.tenant_id = 1004
    -> and
    -> b.table_type >= 10 and b.size > 0 group by a.DATABASE_NAME;
+---------------+---------------------------------------+-----------------+
| DATABASE_NAME | sum(IFNULL(b.size,
0))/1024/1024/1024 | data_size_in_GB |
+---------------+---------------------------------------+-----------------+
| oceanbase     |                        0.003272866830 |  0.003272866830 |
| test          |                        0.161645265296 |  0.177832768298 |
| mysql         |                        0.000002332031 |  0.000002332031 |
+---------------+---------------------------------------+-----------------+
3 rows in set (0.296 sec)

4、

# ./observer -V
<jemalloc>: Unsupported system page size
./observer -V
observer (OceanBase_CE 4.3.3.0)

REVISION: 100000142024101215-0723f9774e5f77a1253149261ba75a94414625d0
BUILD_BRANCH: HEAD
BUILD_TIME: Oct 12 2024 15:52:59
BUILD_FLAGS: RelWithDebInfo
BUILD_INFO: 

Copyright (c) 2011-present OceanBase Inc.

旭辉 · 2024 年11 月 14 日 16:22

这个现象内核的老师已经在分析了，有进展会尽快回复你

AntTech_6KTZWE · 2024 年11 月 14 日 16:42

好的，谢谢您。

旭辉 · 2024 年11 月 15 日 13:51

这个问题已经确认为4.3.x的bug，
问题现象：增量备份数据膨胀问题
问题原因：增量备份重用宏块的路径被跳过了
计划修复：4.3.5BP1

感谢您反馈这个问题

AntTech_6KTZWE · 2024 年11 月 15 日 14:23

请问这个问题修复成本大吗？
可否给说下有问题的代码的位置？或者可否将修复的commit先给我？
由于用的比较急，想先修复用起来。

AntTech_6KTZWE · 2024 年11 月 15 日 14:46

请问什么时候发版4.3.5BP1版本呢？